Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29296 originally caused by: Started by upstream project "master-osmo-msc" build number 34254 originally caused by: Started by upstream project "master-osmo-iuh" build number 12868 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9123 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-libosmo-sccp" build number 9122 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8711 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8956 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2978 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29296 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30079 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12984 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9252 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4707 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins15960149590255833192.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-12 19:08:53 + trial_dir_prefix=trial- + rm -rf trial-2380 trial-2380-bin.tgz trial-2380-run.tgz + trial_dir=trial-2381 + mkdir -p trial-2381 + mv open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29296.tgz osmo-nitb.build-12984.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30079.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz trial-2381 + cat open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29296.md5 osmo-nitb.build-12984.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30079.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29296.md5 osmo-nitb.build-12984.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30079.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2381 combinations: None trial: 'trial-2381' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2381 -------------------------------------------------------------------------------------------- 19:09:05.100290 tst trial-2381: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/log --------------------------------------------------------------------- trial-2381 nitb_sms:sysmo --------------------------------------------------------------------- 19:11:13.922135 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:11:13.926158 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 19:11:13.947384 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 19:11:13.955167 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 19:11:14.010677 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 19:11:14.032355 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 19:11:14.039711 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 19:11:14.574542 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 19:11:14.579367 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 19:11:14.590072 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 19:11:14.959777 tst mo_mt_sms.py: using LAC 30898 19:11:15.197199 tst mo_mt_sms.py: using RAC 43 19:11:15.311094 tst mo_mt_sms.py: using CellId 30898 19:11:15.424205 tst mo_mt_sms.py: using BVCI 30899 19:11:15.540181 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 19:11:15.721913 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 19:11:15.841914 tst mo_mt_sms.py:9: start nitb and bts... 19:11:16.057672 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:11:18.336277 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17633): Launched 19:11:18.639472 run osmo-nitb_10.42.42.2(pid=17634): Launched 19:11:18.802901 run osmo-nitb_10.42.42.2(pid=17634): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17634)] 19:11:18.926426 run osmo-nitb_10.42.42.2(pid=17634): stdout: | (launched: 2022-12-12_19:11:18.582360) 19:11:19.051367 run osmo-nitb_10.42.42.2(pid=17634): stderr: | (launched: 2022-12-12_19:11:18.627010) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:11:19.176377 run osmo-nitb_10.42.42.2(pid=17634): stdout: | (launched: 2022-12-12_19:11:18.582360) 19:11:19.295683 run osmo-nitb_10.42.42.2(pid=17634): stderr: | (launched: 2022-12-12_19:11:18.627010) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:11:19.438710 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17634): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17634) [trial-2381↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17634)] [trial-2381↪nitb_sms:sysmo↪mo_mt_sms.py:11] 19:11:19.446853 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 19:11:19.453383 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17633): Terminating (SIGTERM) 19:11:19.661920 --- ParallelTerminationStrategy: PID 17633 died... 19:11:19.683027 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17633): Terminated: ok {rc=0} 19:11:19.769478 bus /sierra_3: Setting Powered False 19:11:20.873832 bus /sierra_3: Setting Powered False 19:11:21.993305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:sysmo --------------------------------------------------------------------- 19:11:23.178117 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:11:23.182546 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 19:11:23.204856 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 19:11:23.233243 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 19:11:23.290647 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 19:11:23.311878 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 19:11:23.338486 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 19:11:23.885649 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:sysmo mo_mt_sms.py ---------------------------------------------- 19:11:23.890860 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:11:23.901934 tst sms:sysmo: Using 1 x bts (candidates: 1) 19:11:23.944263 tst mo_mt_sms.py: using LAC 30899 19:11:24.070372 tst mo_mt_sms.py: using RAC 44 19:11:24.193882 tst mo_mt_sms.py: using CellId 30899 19:11:24.317486 tst mo_mt_sms.py: using BVCI 30900 19:11:24.433591 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:11:24.444553 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:11:24.455534 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:11:24.466717 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:11:24.478090 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:11:24.489276 tst sms:sysmo: Using 1 x modem (candidates: 2) 19:11:24.604383 tst sms:sysmo: Using 1 x modem (candidates: 2) 19:11:24.725189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:26.487181 run create_hlr_db(pid=17638): Launched 19:11:26.613075 bus /sierra_2: Setting Powered False 19:11:27.673788 run create_hlr_db(pid=17638): Terminated: ok {rc=0} 19:11:28.118677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17640): Launched 19:11:28.444530 run osmo-hlr_10.42.42.2(pid=17641): Launched 19:11:28.570039 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:31.156328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17643): Launched 19:11:31.498875 run osmo-stp_10.42.42.5(pid=17644): Launched 19:11:31.709416 run osmo-msc_10.42.42.6: Starting osmo-msc 19:11:37.270840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17646): Launched 19:11:37.594457 run osmo-msc_10.42.42.6(pid=17647): Launched 19:11:37.773229 run osmo-stp_10.42.42.5(pid=17644): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17644)] 19:11:37.908860 run osmo-stp_10.42.42.5(pid=17644): stdout: | (launched: 2022-12-12_19:11:31.436180) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:38.045222 run osmo-stp_10.42.42.5(pid=17644): stderr: | 20221212191131705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191131705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191131705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191131706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191131708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191131708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191131708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:38.181285 run osmo-stp_10.42.42.5(pid=17644): stdout: | (launched: 2022-12-12_19:11:31.436180) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:38.309534 run osmo-stp_10.42.42.5(pid=17644): stderr: | 20221212191131705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191131705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191131705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191131706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191131708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191131708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191131708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:38.462845 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17644): Process ended prematurely: osmo-stp_10.42.42.5(pid=17644) [trial-2381↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17644)] [trial-2381↪sms:sysmo↪mo_mt_sms.py:16] 19:11:38.471779 tst mo_mt_sms.py:16: Test FAILED (14.6 sec) 19:11:38.499815 run osmo-hlr_10.42.42.2(pid=17641): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17641)] 19:11:38.551262 run osmo-hlr_10.42.42.2(pid=17641): stdout: | (launched: 2022-12-12_19:11:28.383901) 19:11:38.605185 run osmo-hlr_10.42.42.2(pid=17641): stderr: | 20221212191128586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191128587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191128587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191128587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191128587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191128587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191128599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191128607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191128608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191128608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:38.679391 run osmo-msc_10.42.42.6(pid=17647): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17647)] 19:11:38.730712 run osmo-msc_10.42.42.6(pid=17647): stdout: | (launched: 2022-12-12_19:11:37.533748) 19:11:38.783844 run osmo-msc_10.42.42.6(pid=17647): stderr: | 20221212191137861 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191137861 DLGLOBAL DEBUG validating counter group 0x7f0f346b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191137861 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191137861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191137861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191137861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191137863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191137863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191137864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191137864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:11:38.837930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17640): Terminating (SIGTERM) 19:11:38.880426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17643): Terminating (SIGTERM) 19:11:38.923285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17646): Terminating (SIGTERM) 19:11:38.966224 --- ParallelTerminationStrategy: PID 17640 died... 19:11:38.986640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17640): Terminated: ok {rc=0} 19:11:39.034409 --- ParallelTerminationStrategy: PID 17643 died... 19:11:39.054738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17643): Terminated: ok {rc=0} 19:11:39.114049 --- ParallelTerminationStrategy: PID 17646 died... 19:11:39.138519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17646): Terminated: ok {rc=0} 19:11:39.246178 bus /sierra_3: Setting Powered False 19:11:40.357114 bus /sierra_3: Setting Powered False 19:11:41.473178 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:sysmo --------------------------------------------------------------------- 19:11:42.696594 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:11:42.700878 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 19:11:42.722737 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 19:11:42.730268 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 19:11:42.774176 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 19:11:42.794949 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 19:11:42.801656 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 19:11:43.314838 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 19:11:43.320056 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 19:11:43.330693 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 19:11:43.363916 tst assert_extension.py: using LAC 30900 19:11:43.480748 tst assert_extension.py: using RAC 45 19:11:43.597771 tst assert_extension.py: using CellId 30900 19:11:43.723046 tst assert_extension.py: using BVCI 30901 19:11:43.839710 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 19:11:43.953593 tst assert_extension.py:10: start nitb and bts... 19:11:44.154900 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:11:44.772443 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17653): Launched 19:11:45.074004 run osmo-nitb_10.42.42.2(pid=17654): Launched 19:11:45.239903 run osmo-nitb_10.42.42.2(pid=17654): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17654)] 19:11:45.375061 run osmo-nitb_10.42.42.2(pid=17654): stdout: | (launched: 2022-12-12_19:11:45.016796) 19:11:45.512000 run osmo-nitb_10.42.42.2(pid=17654): stderr: | (launched: 2022-12-12_19:11:45.061277) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:11:45.648539 run osmo-nitb_10.42.42.2(pid=17654): stdout: | (launched: 2022-12-12_19:11:45.016796) 19:11:45.779363 run osmo-nitb_10.42.42.2(pid=17654): stderr: | (launched: 2022-12-12_19:11:45.061277) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17654): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17654) [trial-2381↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17654)] 19:11:46.186423 tst osmo-nitb_10.42.42.2(pid=17654): stdout: | (launched: 2022-12-12_19:11:45.016796) 19:11:46.314735 tst osmo-nitb_10.42.42.2(pid=17654): stderr: | (launched: 2022-12-12_19:11:45.061277) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:11:46.460488 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17654): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17654) [trial-2381↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17654)] [trial-2381↪nitb_ussd:sysmo↪assert_extension.py:12] 19:11:46.470089 tst assert_extension.py:12: Test FAILED (3.1 sec) 19:11:46.477865 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17653): Terminating (SIGTERM) 19:11:46.688036 --- ParallelTerminationStrategy: PID 17653 died... 19:11:46.710406 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17653): Terminated: ok {rc=0} 19:11:46.825263 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:sysmo --------------------------------------------------------------------- 19:11:47.994456 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:11:47.998976 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 19:11:48.019973 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 19:11:48.046783 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 19:11:48.081837 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 19:11:48.102860 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 19:11:48.129615 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 19:11:48.656651 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:sysmo assert_extension.py ---------------------------------------------- 19:11:48.663211 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 19:11:48.674884 tst ussd:sysmo: Using 1 x bts (candidates: 1) 19:11:48.710289 tst assert_extension.py: using LAC 30901 19:11:48.839016 tst assert_extension.py: using RAC 46 19:11:48.964488 tst assert_extension.py: using CellId 30901 19:11:49.081876 tst assert_extension.py: using BVCI 30902 19:11:49.190493 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 19:11:49.201258 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 19:11:49.211905 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 19:11:49.222567 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 19:11:49.232865 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 19:11:49.243291 tst ussd:sysmo: Using 1 x modem (candidates: 1) 19:11:49.355071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:49.822845 run create_hlr_db(pid=17658): Launched 19:11:49.936334 bus /sierra_2: Setting Powered False 19:11:50.997319 run create_hlr_db(pid=17658): Terminated: ok {rc=0} 19:11:51.441406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17660): Launched 19:11:51.765238 run osmo-hlr_10.42.42.2(pid=17661): Launched 19:11:51.891033 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:52.454255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17663): Launched 19:11:52.778405 run osmo-stp_10.42.42.5(pid=17664): Launched 19:11:52.901838 run osmo-msc_10.42.42.6: Starting osmo-msc 19:11:53.485477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17666): Launched 19:11:53.809668 run osmo-msc_10.42.42.6(pid=17667): Launched 19:11:53.989195 run osmo-stp_10.42.42.5(pid=17664): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17664)] 19:11:54.125737 run osmo-stp_10.42.42.5(pid=17664): stdout: | (launched: 2022-12-12_19:11:52.717446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:54.263247 run osmo-stp_10.42.42.5(pid=17664): stderr: | 20221212191152913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191152913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191152913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191152913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191152914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191152914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191152914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:54.399593 run osmo-stp_10.42.42.5(pid=17664): stdout: | (launched: 2022-12-12_19:11:52.717446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:54.528374 run osmo-stp_10.42.42.5(pid=17664): stderr: | 20221212191152913 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191152913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191152913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191152913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191152914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191152914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191152914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:54.682618 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17664): Process ended prematurely: osmo-stp_10.42.42.5(pid=17664) [trial-2381↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17664)] [trial-2381↪ussd:sysmo↪assert_extension.py:17] 19:11:54.691596 tst assert_extension.py:17: Test FAILED (6.0 sec) 19:11:54.719837 run osmo-hlr_10.42.42.2(pid=17661): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17661)] 19:11:54.771798 run osmo-hlr_10.42.42.2(pid=17661): stdout: | (launched: 2022-12-12_19:11:51.704328) 19:11:54.824704 run osmo-hlr_10.42.42.2(pid=17661): stderr: | 20221212191151904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191151904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191151905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191151905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191151905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191151905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191151917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191151925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191151925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191151925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:54.898387 run osmo-msc_10.42.42.6(pid=17667): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17667)] 19:11:54.949757 run osmo-msc_10.42.42.6(pid=17667): stdout: | (launched: 2022-12-12_19:11:53.748525) 19:11:55.002603 run osmo-msc_10.42.42.6(pid=17667): stderr: | 20221212191154073 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191154073 DLGLOBAL DEBUG validating counter group 0x7f82a33a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191154074 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191154074 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191154074 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191154074 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191154076 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191154076 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191154076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191154076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:11:55.056491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17660): Terminating (SIGTERM) 19:11:55.099428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17663): Terminating (SIGTERM) 19:11:55.142502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17666): Terminating (SIGTERM) 19:11:55.186025 --- ParallelTerminationStrategy: PID 17660 died... 19:11:55.206421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17660): Terminated: ok {rc=0} 19:11:55.254180 --- ParallelTerminationStrategy: PID 17663 died... 19:11:55.274174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17663): Terminated: ok {rc=0} 19:11:55.321668 --- ParallelTerminationStrategy: PID 17666 died... 19:11:55.341459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17666): Terminated: ok {rc=0} 19:11:55.431532 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:11:56.632715 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:11:56.640393 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:11:56.662925 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:11:56.690849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:11:56.745859 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:11:56.767864 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:11:56.795574 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:11:57.345351 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:11:57.399564 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:11:57.411145 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:11:57.484137 tst mo_mt_call.py: using LAC 30902 19:11:57.619000 tst mo_mt_call.py: using RAC 47 19:11:57.747666 tst mo_mt_call.py: using CellId 30902 19:11:57.875226 tst mo_mt_call.py: using BVCI 30903 19:11:57.993979 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:11:58.005667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:11:58.017369 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:11:58.029119 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:11:58.040861 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:11:58.052704 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:11:58.170889 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:11:58.289790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:58.799988 run create_hlr_db(pid=17673): Launched 19:11:58.924712 bus /sierra_2: Setting Powered False 19:11:59.990274 run create_hlr_db(pid=17673): Terminated: ok {rc=0} 19:12:00.431476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17675): Launched 19:12:00.740740 run osmo-hlr_10.42.42.2(pid=17676): Launched 19:12:00.859558 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:01.495840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17678): Launched 19:12:01.848673 run osmo-stp_10.42.42.5(pid=17679): Launched 19:12:02.181208 run osmo-msc_10.42.42.6: Starting osmo-msc 19:12:02.832039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17681): Launched 19:12:03.162158 run osmo-msc_10.42.42.6(pid=17682): Launched 19:12:03.345648 run osmo-stp_10.42.42.5(pid=17679): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17679)] 19:12:03.483484 run osmo-stp_10.42.42.5(pid=17679): stdout: | (launched: 2022-12-12_19:12:01.783593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:03.621989 run osmo-stp_10.42.42.5(pid=17679): stderr: | 20221212191201980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191201980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191201980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191201982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191201982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191201982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191201982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:03.759951 run osmo-stp_10.42.42.5(pid=17679): stdout: | (launched: 2022-12-12_19:12:01.783593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:03.891056 run osmo-stp_10.42.42.5(pid=17679): stderr: | 20221212191201980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191201980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191201980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191201982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191201982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191201982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191201982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:04.047433 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17679): Process ended prematurely: osmo-stp_10.42.42.5(pid=17679) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17679)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:12:04.057058 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:12:04.085665 run osmo-hlr_10.42.42.2(pid=17676): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17676)] 19:12:04.137129 run osmo-hlr_10.42.42.2(pid=17676): stdout: | (launched: 2022-12-12_19:12:00.682886) 19:12:04.191076 run osmo-hlr_10.42.42.2(pid=17676): stderr: | 20221212191200928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191200928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191200928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191200928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191200928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191200928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191200950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191200970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191200970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191200971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:04.264727 run osmo-msc_10.42.42.6(pid=17682): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17682)] 19:12:04.316032 run osmo-msc_10.42.42.6(pid=17682): stdout: | (launched: 2022-12-12_19:12:03.100049) 19:12:04.369213 run osmo-msc_10.42.42.6(pid=17682): stderr: | 20221212191203427 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191203427 DLGLOBAL DEBUG validating counter group 0x7f5940dc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191203428 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191203428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191203428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191203428 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191203430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191203430 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191203430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191203430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:12:04.422829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17675): Terminating (SIGTERM) 19:12:04.465696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17678): Terminating (SIGTERM) 19:12:04.508451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17681): Terminating (SIGTERM) 19:12:04.551400 --- ParallelTerminationStrategy: PID 17675 died... 19:12:04.571909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17675): Terminated: ok {rc=0} 19:12:04.619620 --- ParallelTerminationStrategy: PID 17678 died... 19:12:04.639565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17678): Terminated: ok {rc=0} 19:12:04.687025 --- ParallelTerminationStrategy: PID 17681 died... 19:12:04.706855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17681): Terminated: ok {rc=0} 19:12:04.796019 bus /sierra_3: Setting Powered False 19:12:05.896165 bus /sierra_3: Setting Powered False 19:12:07.013810 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:12:08.165510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:12:08.177940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:12:08.255218 tst mo_mt_call_osmux.py: using LAC 30903 19:12:08.387193 tst mo_mt_call_osmux.py: using RAC 48 19:12:08.515622 tst mo_mt_call_osmux.py: using CellId 30903 19:12:08.644081 tst mo_mt_call_osmux.py: using BVCI 30904 19:12:08.762924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:12:08.774603 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:12:08.786180 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:12:08.797933 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:12:08.809738 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:12:08.821579 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:12:08.941510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:12:09.058520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:09.570762 run create_hlr_db(pid=17684): Launched 19:12:09.695460 bus /sierra_2: Setting Powered False 19:12:10.761161 run create_hlr_db(pid=17684): Terminated: ok {rc=0} 19:12:11.203164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17686): Launched 19:12:11.513637 run osmo-hlr_10.42.42.2(pid=17687): Launched 19:12:11.633443 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:12.167001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17689): Launched 19:12:12.476057 run osmo-stp_10.42.42.5(pid=17690): Launched 19:12:12.593937 run osmo-msc_10.42.42.6: Starting osmo-msc 19:12:13.151408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17692): Launched 19:12:13.460223 run osmo-msc_10.42.42.6(pid=17693): Launched 19:12:13.631866 run osmo-stp_10.42.42.5(pid=17690): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17690)] 19:12:13.761143 run osmo-stp_10.42.42.5(pid=17690): stdout: | (launched: 2022-12-12_19:12:12.417653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:13.890829 run osmo-stp_10.42.42.5(pid=17690): stderr: | 20221212191212592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191212592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191212592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191212593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191212593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191212593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191212593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:14.018698 run osmo-stp_10.42.42.5(pid=17690): stdout: | (launched: 2022-12-12_19:12:12.417653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:14.140122 run osmo-stp_10.42.42.5(pid=17690): stderr: | 20221212191212592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191212592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191212592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191212593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191212593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191212593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191212593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:14.286285 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17690): Process ended prematurely: osmo-stp_10.42.42.5(pid=17690) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17690)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:12:14.295017 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:12:14.321472 run osmo-hlr_10.42.42.2(pid=17687): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17687)] 19:12:14.369832 run osmo-hlr_10.42.42.2(pid=17687): stdout: | (launched: 2022-12-12_19:12:11.455298) 19:12:14.419875 run osmo-hlr_10.42.42.2(pid=17687): stderr: | 20221212191211637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191211637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191211637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191211637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191211637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191211637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191211652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191211661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191211661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191211661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:14.489393 run osmo-msc_10.42.42.6(pid=17693): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17693)] 19:12:14.537918 run osmo-msc_10.42.42.6(pid=17693): stdout: | (launched: 2022-12-12_19:12:13.401773) 19:12:14.588089 run osmo-msc_10.42.42.6(pid=17693): stderr: | 20221212191213677 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191213677 DLGLOBAL DEBUG validating counter group 0x7fd2a1463c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191213677 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191213677 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191213677 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191213677 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191213679 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191213679 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191213680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191213680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:12:14.638326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17686): Terminating (SIGTERM) 19:12:14.678149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17689): Terminating (SIGTERM) 19:12:14.718042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17692): Terminating (SIGTERM) 19:12:14.758027 --- ParallelTerminationStrategy: PID 17686 died... 19:12:14.777310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17686): Terminated: ok {rc=0} 19:12:14.822070 --- ParallelTerminationStrategy: PID 17689 died... 19:12:14.841091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17689): Terminated: ok {rc=0} 19:12:14.886053 --- ParallelTerminationStrategy: PID 17692 died... 19:12:14.905267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17692): Terminated: ok {rc=0} 19:12:14.991051 bus /sierra_3: Setting Powered False 19:12:16.087971 bus /sierra_3: Setting Powered False 19:12:17.223827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:12:18.460067 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:12:18.466689 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:12:18.487252 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:12:18.513632 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:12:18.564229 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:12:18.584626 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:12:18.610741 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:12:19.167110 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:12:19.216091 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:19.227085 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:12:19.281456 tst mo_mt_call.py: using LAC 30904 19:12:19.402333 tst mo_mt_call.py: using RAC 49 19:12:19.521007 tst mo_mt_call.py: using CellId 30904 19:12:19.638830 tst mo_mt_call.py: using BVCI 30905 19:12:19.751545 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:19.763072 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:19.774011 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:19.784854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:19.795837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:19.806810 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:12:19.924105 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:12:20.040008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:20.517986 run create_hlr_db(pid=17698): Launched 19:12:20.643372 bus /sierra_2: Setting Powered False 19:12:21.704542 run create_hlr_db(pid=17698): Terminated: ok {rc=0} 19:12:22.155020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Launched 19:12:22.485257 run osmo-hlr_10.42.42.2(pid=17701): Launched 19:12:22.611971 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:23.181813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17703): Launched 19:12:23.512146 run osmo-stp_10.42.42.5(pid=17704): Launched 19:12:23.638381 run osmo-msc_10.42.42.6: Starting osmo-msc 19:12:24.234904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17706): Launched 19:12:24.565889 run osmo-msc_10.42.42.6(pid=17707): Launched 19:12:24.748784 run osmo-stp_10.42.42.5(pid=17704): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17704)] 19:12:24.887820 run osmo-stp_10.42.42.5(pid=17704): stdout: | (launched: 2022-12-12_19:12:23.450642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:25.027097 run osmo-stp_10.42.42.5(pid=17704): stderr: | 20221212191223645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191223645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191223645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191223646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191223646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191223646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191223646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:25.165731 run osmo-stp_10.42.42.5(pid=17704): stdout: | (launched: 2022-12-12_19:12:23.450642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:25.296920 run osmo-stp_10.42.42.5(pid=17704): stderr: | 20221212191223645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191223645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191223645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191223646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191223646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191223646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191223646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:25.453836 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17704): Process ended prematurely: osmo-stp_10.42.42.5(pid=17704) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17704)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:12:25.463504 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:12:25.492271 run osmo-hlr_10.42.42.2(pid=17701): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17701)] 19:12:25.543804 run osmo-hlr_10.42.42.2(pid=17701): stdout: | (launched: 2022-12-12_19:12:22.423778) 19:12:25.597400 run osmo-hlr_10.42.42.2(pid=17701): stderr: | 20221212191222627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191222627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191222627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191222627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191222627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191222627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191222640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191222648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191222649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191222649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:25.671351 run osmo-msc_10.42.42.6(pid=17707): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17707)] 19:12:25.722751 run osmo-msc_10.42.42.6(pid=17707): stdout: | (launched: 2022-12-12_19:12:24.503804) 19:12:25.775868 run osmo-msc_10.42.42.6(pid=17707): stderr: | 20221212191224832 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191224832 DLGLOBAL DEBUG validating counter group 0x7fc20b568c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191224832 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191224832 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191224832 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191224833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191224834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191224835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191224835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191224835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:12:25.829422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Terminating (SIGTERM) 19:12:25.872427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17703): Terminating (SIGTERM) 19:12:25.915340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17706): Terminating (SIGTERM) 19:12:25.958456 --- ParallelTerminationStrategy: PID 17700 died... 19:12:25.978854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Terminated: ok {rc=0} 19:12:26.026661 --- ParallelTerminationStrategy: PID 17703 died... 19:12:26.046495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17703): Terminated: ok {rc=0} 19:12:26.094749 --- ParallelTerminationStrategy: PID 17706 died... 19:12:26.115042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17706): Terminated: ok {rc=0} 19:12:26.205239 bus /sierra_3: Setting Powered False 19:12:27.308071 bus /sierra_3: Setting Powered False 19:12:28.425169 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:12:29.575628 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:29.587935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:12:29.646880 tst mo_mt_call_osmux.py: using LAC 30905 19:12:29.776227 tst mo_mt_call_osmux.py: using RAC 50 19:12:29.898707 tst mo_mt_call_osmux.py: using CellId 30905 19:12:30.019842 tst mo_mt_call_osmux.py: using BVCI 30906 19:12:30.131224 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:30.142536 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:30.153720 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:30.165457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:30.176895 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:12:30.188885 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:12:30.308271 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:12:30.425420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:30.935057 run create_hlr_db(pid=17709): Launched 19:12:31.095820 bus /sierra_2: Setting Powered False 19:12:32.158774 run create_hlr_db(pid=17709): Terminated: ok {rc=0} 19:12:32.626932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17711): Launched 19:12:32.957795 run osmo-hlr_10.42.42.2(pid=17712): Launched 19:12:33.082562 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:33.653561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17714): Launched 19:12:33.983654 run osmo-stp_10.42.42.5(pid=17715): Launched 19:12:34.108899 run osmo-msc_10.42.42.6: Starting osmo-msc 19:12:34.704640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17717): Launched 19:12:35.034395 run osmo-msc_10.42.42.6(pid=17718): Launched 19:12:35.216927 run osmo-stp_10.42.42.5(pid=17715): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17715)] 19:12:35.355418 run osmo-stp_10.42.42.5(pid=17715): stdout: | (launched: 2022-12-12_19:12:33.921937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:35.494200 run osmo-stp_10.42.42.5(pid=17715): stderr: | 20221212191234116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191234116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191234117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191234117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191234119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191234119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191234119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:35.632399 run osmo-stp_10.42.42.5(pid=17715): stdout: | (launched: 2022-12-12_19:12:33.921937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:35.762957 run osmo-stp_10.42.42.5(pid=17715): stderr: | 20221212191234116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191234116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191234117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191234117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191234119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191234119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191234119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:35.919125 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17715): Process ended prematurely: osmo-stp_10.42.42.5(pid=17715) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17715)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:12:35.928767 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:12:35.957373 run osmo-hlr_10.42.42.2(pid=17712): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17712)] 19:12:36.008316 run osmo-hlr_10.42.42.2(pid=17712): stdout: | (launched: 2022-12-12_19:12:32.896019) 19:12:36.061078 run osmo-hlr_10.42.42.2(pid=17712): stderr: | 20221212191233099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191233099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191233099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191233099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191233099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191233099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191233111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191233119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191233119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191233119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:36.134021 run osmo-msc_10.42.42.6(pid=17718): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17718)] 19:12:36.184691 run osmo-msc_10.42.42.6(pid=17718): stdout: | (launched: 2022-12-12_19:12:34.972615) 19:12:36.237499 run osmo-msc_10.42.42.6(pid=17718): stderr: | 20221212191235298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191235298 DLGLOBAL DEBUG validating counter group 0x7fc4497e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191235298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191235298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191235299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191235299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191235300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191235301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191235301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191235301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:12:36.290317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17711): Terminating (SIGTERM) 19:12:36.332750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17714): Terminating (SIGTERM) 19:12:36.375110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17717): Terminating (SIGTERM) 19:12:36.417739 --- ParallelTerminationStrategy: PID 17711 died... 19:12:36.437863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17711): Terminated: ok {rc=0} 19:12:36.485093 --- ParallelTerminationStrategy: PID 17714 died... 19:12:36.504811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17714): Terminated: ok {rc=0} 19:12:36.551787 --- ParallelTerminationStrategy: PID 17717 died... 19:12:36.571559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17717): Terminated: ok {rc=0} 19:12:36.661155 bus /sierra_3: Setting Powered False 19:12:37.762067 bus /sierra_3: Setting Powered False 19:12:38.881084 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:12:40.121020 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:12:40.128133 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:12:40.150492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:12:40.178494 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:12:40.233834 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:12:40.255736 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:12:40.283384 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:12:40.833104 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:12:40.886103 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:40.897618 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:12:40.955435 tst mo_mt_call.py: using LAC 30906 19:12:41.084791 tst mo_mt_call.py: using RAC 51 19:12:41.214771 tst mo_mt_call.py: using CellId 30906 19:12:41.344336 tst mo_mt_call.py: using BVCI 30907 19:12:41.463419 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:41.475175 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:41.486544 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:41.498242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:41.509939 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:41.521670 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:12:41.639899 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:12:41.761983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:42.239477 run create_hlr_db(pid=17723): Launched 19:12:42.364888 bus /sierra_2: Setting Powered False 19:12:43.426062 run create_hlr_db(pid=17723): Terminated: ok {rc=0} 19:12:43.856320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17725): Launched 19:12:44.165531 run osmo-hlr_10.42.42.2(pid=17726): Launched 19:12:44.282592 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:44.816858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17728): Launched 19:12:45.125651 run osmo-stp_10.42.42.5(pid=17729): Launched 19:12:45.243112 run osmo-msc_10.42.42.6: Starting osmo-msc 19:12:45.798814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17731): Launched 19:12:46.146493 run osmo-msc_10.42.42.6(pid=17732): Launched 19:12:46.467757 run osmo-stp_10.42.42.5(pid=17729): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17729)] 19:12:46.640273 run osmo-stp_10.42.42.5(pid=17729): stdout: | (launched: 2022-12-12_19:12:45.067453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:46.991932 run osmo-stp_10.42.42.5(pid=17729): stderr: | 20221212191245241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191245242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191245242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191245242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191245243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191245243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191245243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:47.238439 run osmo-stp_10.42.42.5(pid=17729): stdout: | (launched: 2022-12-12_19:12:45.067453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:47.361854 run osmo-stp_10.42.42.5(pid=17729): stderr: | 20221212191245241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191245242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191245242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191245242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191245243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191245243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191245243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:47.508526 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17729): Process ended prematurely: osmo-stp_10.42.42.5(pid=17729) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17729)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:12:47.517578 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:12:47.544303 run osmo-hlr_10.42.42.2(pid=17726): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17726)] 19:12:47.592747 run osmo-hlr_10.42.42.2(pid=17726): stdout: | (launched: 2022-12-12_19:12:44.106892) 19:12:47.643193 run osmo-hlr_10.42.42.2(pid=17726): stderr: | 20221212191244286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191244286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191244286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191244286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191244286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191244286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191244298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191244307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191244307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191244307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:47.713131 run osmo-msc_10.42.42.6(pid=17732): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17732)] 19:12:47.761252 run osmo-msc_10.42.42.6(pid=17732): stdout: | (launched: 2022-12-12_19:12:46.084503) 19:12:47.811318 run osmo-msc_10.42.42.6(pid=17732): stderr: | 20221212191246751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191246753 DLGLOBAL DEBUG validating counter group 0x7fb2db73cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191246753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191246754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191246754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191246755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191246761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191246762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191246762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191246762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:12:47.861972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17725): Terminating (SIGTERM) 19:12:47.901829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17728): Terminating (SIGTERM) 19:12:47.941774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17731): Terminating (SIGTERM) 19:12:47.981878 --- ParallelTerminationStrategy: PID 17725 died... 19:12:48.001179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17725): Terminated: ok {rc=0} 19:12:48.045553 --- ParallelTerminationStrategy: PID 17728 died... 19:12:48.064343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17728): Terminated: ok {rc=0} 19:12:48.109228 --- ParallelTerminationStrategy: PID 17731 died... 19:12:48.127934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17731): Terminated: ok {rc=0} 19:12:48.215504 bus /sierra_3: Setting Powered False 19:12:49.317693 bus /sierra_3: Setting Powered False 19:12:50.435315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:12:51.585182 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:51.597139 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:12:51.653481 tst mo_mt_call_osmux.py: using LAC 30907 19:12:51.783664 tst mo_mt_call_osmux.py: using RAC 52 19:12:51.918704 tst mo_mt_call_osmux.py: using CellId 30907 19:12:52.045125 tst mo_mt_call_osmux.py: using BVCI 30908 19:12:52.156016 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:52.167383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:52.178658 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:52.189834 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:52.200607 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:12:52.211577 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:12:52.330742 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:12:52.446616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:52.923848 run create_hlr_db(pid=17734): Launched 19:12:53.049424 bus /sierra_2: Setting Powered False 19:12:54.110898 run create_hlr_db(pid=17734): Terminated: ok {rc=0} 19:12:54.561129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17736): Launched 19:12:54.892188 run osmo-hlr_10.42.42.2(pid=17737): Launched 19:12:55.017837 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:55.591129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17739): Launched 19:12:55.922188 run osmo-stp_10.42.42.5(pid=17740): Launched 19:12:56.048106 run osmo-msc_10.42.42.6: Starting osmo-msc 19:12:56.644068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17742): Launched 19:12:56.976640 run osmo-msc_10.42.42.6(pid=17743): Launched 19:12:57.159152 run osmo-stp_10.42.42.5(pid=17740): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17740)] 19:12:57.299847 run osmo-stp_10.42.42.5(pid=17740): stdout: | (launched: 2022-12-12_19:12:55.860261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:57.440191 run osmo-stp_10.42.42.5(pid=17740): stderr: | 20221212191256055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191256055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191256055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191256056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191256056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191256056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191256056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:57.578445 run osmo-stp_10.42.42.5(pid=17740): stdout: | (launched: 2022-12-12_19:12:55.860261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:57.709507 run osmo-stp_10.42.42.5(pid=17740): stderr: | 20221212191256055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191256055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191256055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191256056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191256056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191256056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191256056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:57.866440 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17740): Process ended prematurely: osmo-stp_10.42.42.5(pid=17740) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17740)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:12:57.876057 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:12:57.904413 run osmo-hlr_10.42.42.2(pid=17737): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17737)] 19:12:57.955985 run osmo-hlr_10.42.42.2(pid=17737): stdout: | (launched: 2022-12-12_19:12:54.830836) 19:12:58.008689 run osmo-hlr_10.42.42.2(pid=17737): stderr: | 20221212191255031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191255031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191255032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191255032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191255032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191255032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191255044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191255053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191255053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191255053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:58.082168 run osmo-msc_10.42.42.6(pid=17743): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17743)] 19:12:58.133445 run osmo-msc_10.42.42.6(pid=17743): stdout: | (launched: 2022-12-12_19:12:56.914828) 19:12:58.186392 run osmo-msc_10.42.42.6(pid=17743): stderr: | 20221212191257239 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191257239 DLGLOBAL DEBUG validating counter group 0x7fb360e9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191257239 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191257239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191257240 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191257240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191257242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191257242 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191257242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191257242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:12:58.239824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17736): Terminating (SIGTERM) 19:12:58.282514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17739): Terminating (SIGTERM) 19:12:58.324930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17742): Terminating (SIGTERM) 19:12:58.367714 --- ParallelTerminationStrategy: PID 17736 died... 19:12:58.387986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17736): Terminated: ok {rc=0} 19:12:58.435343 --- ParallelTerminationStrategy: PID 17739 died... 19:12:58.455150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17739): Terminated: ok {rc=0} 19:12:58.502440 --- ParallelTerminationStrategy: PID 17742 died... 19:12:58.522186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17742): Terminated: ok {rc=0} 19:12:58.611510 bus /sierra_3: Setting Powered False 19:12:59.712205 bus /sierra_3: Setting Powered False 19:13:00.829358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:13:02.108102 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:02.118358 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:13:02.143390 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:13:02.176135 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:13:02.228191 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:13:02.254556 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:13:02.285055 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:13:02.827031 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:13:02.881692 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:02.893325 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:13:02.954607 tst mo_mt_call.py: using LAC 30908 19:13:03.082800 tst mo_mt_call.py: using RAC 53 19:13:03.209689 tst mo_mt_call.py: using CellId 30908 19:13:03.329678 tst mo_mt_call.py: using BVCI 30909 19:13:03.441072 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:03.452290 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:03.463498 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:03.474595 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:03.485691 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:03.496735 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:13:03.616298 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:13:03.733932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:04.212276 run create_hlr_db(pid=17748): Launched 19:13:04.338004 bus /sierra_2: Setting Powered False 19:13:05.403390 run create_hlr_db(pid=17748): Terminated: ok {rc=0} 19:13:05.846089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17750): Launched 19:13:06.154717 run osmo-hlr_10.42.42.2(pid=17751): Launched 19:13:06.271102 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:06.802811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17753): Launched 19:13:07.111728 run osmo-stp_10.42.42.5(pid=17754): Launched 19:13:07.228045 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:07.786659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17756): Launched 19:13:08.096236 run osmo-msc_10.42.42.6(pid=17757): Launched 19:13:08.268222 run osmo-stp_10.42.42.5(pid=17754): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17754)] 19:13:08.397986 run osmo-stp_10.42.42.5(pid=17754): stdout: | (launched: 2022-12-12_19:13:07.053716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:08.527886 run osmo-stp_10.42.42.5(pid=17754): stderr: | 20221212191307228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191307228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191307228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191307229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191307229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191307229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191307229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:08.655834 run osmo-stp_10.42.42.5(pid=17754): stdout: | (launched: 2022-12-12_19:13:07.053716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:08.778034 run osmo-stp_10.42.42.5(pid=17754): stderr: | 20221212191307228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191307228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191307228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191307229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191307229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191307229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191307229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:08.924241 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17754): Process ended prematurely: osmo-stp_10.42.42.5(pid=17754) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17754)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:13:08.933286 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:13:08.959860 run osmo-hlr_10.42.42.2(pid=17751): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17751)] 19:13:09.008430 run osmo-hlr_10.42.42.2(pid=17751): stdout: | (launched: 2022-12-12_19:13:06.096287) 19:13:09.058468 run osmo-hlr_10.42.42.2(pid=17751): stderr: | 20221212191306277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191306277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191306277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191306277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191306277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191306277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191306337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191306346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191306346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191306346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:09.128281 run osmo-msc_10.42.42.6(pid=17757): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17757)] 19:13:09.176711 run osmo-msc_10.42.42.6(pid=17757): stdout: | (launched: 2022-12-12_19:13:08.037849) 19:13:09.226720 run osmo-msc_10.42.42.6(pid=17757): stderr: | 20221212191308312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191308312 DLGLOBAL DEBUG validating counter group 0x7ff26718ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191308312 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191308312 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191308312 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191308313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191308314 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191308315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191308315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191308315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:09.277241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17750): Terminating (SIGTERM) 19:13:09.317120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17753): Terminating (SIGTERM) 19:13:09.357813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17756): Terminating (SIGTERM) 19:13:09.398461 --- ParallelTerminationStrategy: PID 17750 died... 19:13:09.417872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17750): Terminated: ok {rc=0} 19:13:09.462538 --- ParallelTerminationStrategy: PID 17753 died... 19:13:09.481492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17753): Terminated: ok {rc=0} 19:13:09.526019 --- ParallelTerminationStrategy: PID 17756 died... 19:13:09.544915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17756): Terminated: ok {rc=0} 19:13:09.632208 bus /sierra_3: Setting Powered False 19:13:10.733782 bus /sierra_3: Setting Powered False 19:13:11.848908 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:13:13.001335 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:13.013910 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:13:13.072368 tst mo_mt_call_osmux.py: using LAC 30909 19:13:13.204942 tst mo_mt_call_osmux.py: using RAC 54 19:13:13.333993 tst mo_mt_call_osmux.py: using CellId 30909 19:13:13.461149 tst mo_mt_call_osmux.py: using BVCI 30910 19:13:13.580683 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:13.600679 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:13.612300 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:13.624367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:13.636053 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:13:13.647713 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:13:13.764903 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:13:13.880709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:14.359632 run create_hlr_db(pid=17759): Launched 19:13:14.485357 bus /sierra_2: Setting Powered False 19:13:15.546734 run create_hlr_db(pid=17759): Terminated: ok {rc=0} 19:13:16.031185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17761): Launched 19:13:16.382152 run osmo-hlr_10.42.42.2(pid=17762): Launched 19:13:16.645078 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:17.280422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17764): Launched 19:13:17.612885 run osmo-stp_10.42.42.5(pid=17765): Launched 19:13:17.742571 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:18.342560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17767): Launched 19:13:18.675892 run osmo-msc_10.42.42.6(pid=17768): Launched 19:13:18.859582 run osmo-stp_10.42.42.5(pid=17765): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17765)] 19:13:18.999259 run osmo-stp_10.42.42.5(pid=17765): stdout: | (launched: 2022-12-12_19:13:17.551086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:19.140167 run osmo-stp_10.42.42.5(pid=17765): stderr: | 20221212191317744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191317744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191317744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191317745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191317745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191317745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191317745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:19.279485 run osmo-stp_10.42.42.5(pid=17765): stdout: | (launched: 2022-12-12_19:13:17.551086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:19.411208 run osmo-stp_10.42.42.5(pid=17765): stderr: | 20221212191317744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191317744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191317744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191317745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191317745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191317745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191317745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:19.569269 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17765): Process ended prematurely: osmo-stp_10.42.42.5(pid=17765) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17765)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:13:19.579143 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 19:13:19.608319 run osmo-hlr_10.42.42.2(pid=17762): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17762)] 19:13:19.660297 run osmo-hlr_10.42.42.2(pid=17762): stdout: | (launched: 2022-12-12_19:13:16.317831) 19:13:19.713872 run osmo-hlr_10.42.42.2(pid=17762): stderr: | 20221212191316542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191316542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191316542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191316542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191316542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191316542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191316585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191316593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191316593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191316593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:19.788087 run osmo-msc_10.42.42.6(pid=17768): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17768)] 19:13:19.839719 run osmo-msc_10.42.42.6(pid=17768): stdout: | (launched: 2022-12-12_19:13:18.613788) 19:13:19.893096 run osmo-msc_10.42.42.6(pid=17768): stderr: | 20221212191318940 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191318940 DLGLOBAL DEBUG validating counter group 0x7f366d6d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191318940 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191318940 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191318940 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191318941 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191318943 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191318943 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191318943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191318943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:19.946749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17761): Terminating (SIGTERM) 19:13:19.989476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17764): Terminating (SIGTERM) 19:13:20.032359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17767): Terminating (SIGTERM) 19:13:20.075736 --- ParallelTerminationStrategy: PID 17761 died... 19:13:20.096190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17761): Terminated: ok {rc=0} 19:13:20.144547 --- ParallelTerminationStrategy: PID 17764 died... 19:13:20.164531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17764): Terminated: ok {rc=0} 19:13:20.212341 --- ParallelTerminationStrategy: PID 17767 died... 19:13:20.232660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17767): Terminated: ok {rc=0} 19:13:20.322986 bus /sierra_3: Setting Powered False 19:13:21.423424 bus /sierra_3: Setting Powered False 19:13:22.542133 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:13:23.782292 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:23.789352 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:13:23.811761 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:13:23.838102 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:13:23.888749 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:13:23.909287 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:13:23.935334 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:13:24.490869 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:13:24.544879 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:24.556657 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:13:24.615534 tst mo_mt_call.py: using LAC 30910 19:13:24.735165 tst mo_mt_call.py: using RAC 55 19:13:24.855828 tst mo_mt_call.py: using CellId 30910 19:13:24.975830 tst mo_mt_call.py: using BVCI 30911 19:13:25.087134 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:25.098388 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:25.109326 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:25.120122 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:25.131080 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:25.141973 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:13:25.262552 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:13:25.379423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:25.858389 run create_hlr_db(pid=17773): Launched 19:13:25.983735 bus /sierra_2: Setting Powered False 19:13:27.045751 run create_hlr_db(pid=17773): Terminated: ok {rc=0} 19:13:27.498442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Launched 19:13:27.829198 run osmo-hlr_10.42.42.2(pid=17776): Launched 19:13:27.954637 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:28.523148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Launched 19:13:28.854449 run osmo-stp_10.42.42.5(pid=17779): Launched 19:13:28.980311 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:29.580233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17781): Launched 19:13:29.911742 run osmo-msc_10.42.42.6(pid=17782): Launched 19:13:30.095217 run osmo-stp_10.42.42.5(pid=17779): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] 19:13:30.235338 run osmo-stp_10.42.42.5(pid=17779): stdout: | (launched: 2022-12-12_19:13:28.792123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:30.375555 run osmo-stp_10.42.42.5(pid=17779): stderr: | 20221212191328988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191328989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191328989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191328989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191328990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191328990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191328990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:30.514777 run osmo-stp_10.42.42.5(pid=17779): stdout: | (launched: 2022-12-12_19:13:28.792123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:30.646614 run osmo-stp_10.42.42.5(pid=17779): stderr: | 20221212191328988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191328989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191328989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191328989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191328990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191328990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191328990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:30.803883 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17779): Process ended prematurely: osmo-stp_10.42.42.5(pid=17779) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:13:30.813731 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:13:30.844712 run osmo-hlr_10.42.42.2(pid=17776): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17776)] 19:13:30.902869 run osmo-hlr_10.42.42.2(pid=17776): stdout: | (launched: 2022-12-12_19:13:27.767452) 19:13:30.957981 run osmo-hlr_10.42.42.2(pid=17776): stderr: | 20221212191327969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191327969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191327969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191327969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191327969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191327969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191328090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191328099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191328099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191328099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:31.033859 run osmo-msc_10.42.42.6(pid=17782): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17782)] 19:13:31.087511 run osmo-msc_10.42.42.6(pid=17782): stdout: | (launched: 2022-12-12_19:13:29.849807) 19:13:31.142920 run osmo-msc_10.42.42.6(pid=17782): stderr: | 20221212191330176 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191330177 DLGLOBAL DEBUG validating counter group 0x7f5186548c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191330177 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191330177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191330177 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191330177 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191330179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191330179 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191330179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191330179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:31.198917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Terminating (SIGTERM) 19:13:31.245028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Terminating (SIGTERM) 19:13:31.291792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17781): Terminating (SIGTERM) 19:13:31.338766 --- ParallelTerminationStrategy: PID 17775 died... 19:13:31.359651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Terminated: ok {rc=0} 19:13:31.410557 --- ParallelTerminationStrategy: PID 17778 died... 19:13:31.431649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Terminated: ok {rc=0} 19:13:31.482365 --- ParallelTerminationStrategy: PID 17781 died... 19:13:31.503364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17781): Terminated: ok {rc=0} 19:13:31.597858 bus /sierra_3: Setting Powered False 19:13:32.700594 bus /sierra_3: Setting Powered False 19:13:33.820040 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:13:34.971882 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:34.985313 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:13:35.047187 tst mo_mt_call_osmux.py: using LAC 30911 19:13:35.174882 tst mo_mt_call_osmux.py: using RAC 56 19:13:35.301739 tst mo_mt_call_osmux.py: using CellId 30911 19:13:35.430306 tst mo_mt_call_osmux.py: using BVCI 30912 19:13:35.549778 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:35.561606 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:35.572875 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:35.585157 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:35.596898 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:13:35.608927 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:13:35.725944 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:13:35.849917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:36.362283 run create_hlr_db(pid=17784): Launched 19:13:36.487896 bus /sierra_2: Setting Powered False 19:13:37.551911 run create_hlr_db(pid=17784): Terminated: ok {rc=0} 19:13:37.992733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17786): Launched 19:13:38.301416 run osmo-hlr_10.42.42.2(pid=17787): Launched 19:13:38.418061 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:38.947930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17789): Launched 19:13:39.256485 run osmo-stp_10.42.42.5(pid=17790): Launched 19:13:39.374161 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:39.931978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17792): Launched 19:13:40.241671 run osmo-msc_10.42.42.6(pid=17793): Launched 19:13:40.412882 run osmo-stp_10.42.42.5(pid=17790): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17790)] 19:13:40.542266 run osmo-stp_10.42.42.5(pid=17790): stdout: | (launched: 2022-12-12_19:13:39.198515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:40.671847 run osmo-stp_10.42.42.5(pid=17790): stderr: | 20221212191339370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191339370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191339370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191339370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191339373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191339374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191339374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:40.798870 run osmo-stp_10.42.42.5(pid=17790): stdout: | (launched: 2022-12-12_19:13:39.198515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:40.920592 run osmo-stp_10.42.42.5(pid=17790): stderr: | 20221212191339370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191339370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191339370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191339370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191339373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191339374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191339374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:41.066453 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17790): Process ended prematurely: osmo-stp_10.42.42.5(pid=17790) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17790)] [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:13:41.075550 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:13:41.102164 run osmo-hlr_10.42.42.2(pid=17787): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17787)] 19:13:41.150437 run osmo-hlr_10.42.42.2(pid=17787): stdout: | (launched: 2022-12-12_19:13:38.243109) 19:13:41.200454 run osmo-hlr_10.42.42.2(pid=17787): stderr: | 20221212191338422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191338422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191338422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191338422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191338422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191338422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191338461 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191338472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191338472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191338472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:41.269620 run osmo-msc_10.42.42.6(pid=17793): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17793)] 19:13:41.317489 run osmo-msc_10.42.42.6(pid=17793): stdout: | (launched: 2022-12-12_19:13:40.183154) 19:13:41.367120 run osmo-msc_10.42.42.6(pid=17793): stderr: | 20221212191340460 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191340460 DLGLOBAL DEBUG validating counter group 0x7fd1680b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191340461 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191340461 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191340461 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191340461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191340463 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191340464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191340464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191340464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:41.417222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17786): Terminating (SIGTERM) 19:13:41.456932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17789): Terminating (SIGTERM) 19:13:41.496611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17792): Terminating (SIGTERM) 19:13:41.536277 --- ParallelTerminationStrategy: PID 17786 died... 19:13:41.555453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17786): Terminated: ok {rc=0} 19:13:41.600426 --- ParallelTerminationStrategy: PID 17789 died... 19:13:41.619286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17789): Terminated: ok {rc=0} 19:13:41.663854 --- ParallelTerminationStrategy: PID 17792 died... 19:13:41.682558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17792): Terminated: ok {rc=0} 19:13:41.768378 bus /sierra_3: Setting Powered False 19:13:42.869058 bus /sierra_3: Setting Powered False 19:13:43.985050 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:13:45.218214 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:45.224613 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:13:45.245568 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:13:45.272571 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:13:45.331112 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:13:45.352034 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:13:45.378366 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:13:45.954498 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:13:46.012712 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:46.028163 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:13:46.087837 tst mo_mt_call.py: using LAC 30912 19:13:46.265946 tst mo_mt_call.py: using RAC 57 19:13:46.401117 tst mo_mt_call.py: using CellId 30912 19:13:46.555740 tst mo_mt_call.py: using BVCI 30913 19:13:46.702555 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:46.716071 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:46.727394 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:46.739517 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:46.751855 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:46.764121 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:13:46.883649 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:13:47.002242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:47.552844 run create_hlr_db(pid=17798): Launched 19:13:47.680150 bus /sierra_2: Setting Powered False 19:13:48.745080 run create_hlr_db(pid=17798): Terminated: ok {rc=0} 19:13:49.188722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17800): Launched 19:13:49.499875 run osmo-hlr_10.42.42.2(pid=17801): Launched 19:13:49.618779 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:50.189471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17803): Launched 19:13:50.521318 run osmo-stp_10.42.42.5(pid=17804): Launched 19:13:50.647404 run osmo-msc_10.42.42.6: Starting osmo-msc 19:13:51.244291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17806): Launched 19:13:51.575971 run osmo-msc_10.42.42.6(pid=17807): Launched 19:13:51.759597 run osmo-stp_10.42.42.5(pid=17804): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17804)] 19:13:51.899917 run osmo-stp_10.42.42.5(pid=17804): stdout: | (launched: 2022-12-12_19:13:50.459479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:52.040540 run osmo-stp_10.42.42.5(pid=17804): stderr: | 20221212191350656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191350656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191350656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191350656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191350659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191350659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191350659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:52.178444 run osmo-stp_10.42.42.5(pid=17804): stdout: | (launched: 2022-12-12_19:13:50.459479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:52.310294 run osmo-stp_10.42.42.5(pid=17804): stderr: | 20221212191350656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191350656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191350656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191350656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191350659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191350659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191350659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:52.467783 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17804): Process ended prematurely: osmo-stp_10.42.42.5(pid=17804) [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17804)] [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:13:52.477425 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:13:52.505941 run osmo-hlr_10.42.42.2(pid=17801): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17801)] 19:13:52.557479 run osmo-hlr_10.42.42.2(pid=17801): stdout: | (launched: 2022-12-12_19:13:49.441560) 19:13:52.610413 run osmo-hlr_10.42.42.2(pid=17801): stderr: | 20221212191349623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191349623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191349623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191349623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191349623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191349623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191349650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191349660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191349660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191349660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:52.684326 run osmo-msc_10.42.42.6(pid=17807): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17807)] 19:13:52.735555 run osmo-msc_10.42.42.6(pid=17807): stdout: | (launched: 2022-12-12_19:13:51.513984) 19:13:52.788517 run osmo-msc_10.42.42.6(pid=17807): stderr: | 20221212191351838 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191351838 DLGLOBAL DEBUG validating counter group 0x7feb1d988c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191351838 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191351838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191351839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191351839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191351840 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191351841 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191351841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191351841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:13:52.841904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17800): Terminating (SIGTERM) 19:13:52.884705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17803): Terminating (SIGTERM) 19:13:52.927819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17806): Terminating (SIGTERM) 19:13:52.971108 --- ParallelTerminationStrategy: PID 17800 died... 19:13:52.991501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17800): Terminated: ok {rc=0} 19:13:53.039344 --- ParallelTerminationStrategy: PID 17803 died... 19:13:53.059309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17803): Terminated: ok {rc=0} 19:13:53.107105 --- ParallelTerminationStrategy: PID 17806 died... 19:13:53.127039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17806): Terminated: ok {rc=0} 19:13:53.217691 bus /sierra_3: Setting Powered False 19:13:54.319736 bus /sierra_3: Setting Powered False 19:13:55.438917 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:13:56.592081 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:56.604657 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:13:56.663952 tst mo_mt_call_osmux.py: using LAC 30913 19:13:56.793811 tst mo_mt_call_osmux.py: using RAC 58 19:13:56.920366 tst mo_mt_call_osmux.py: using CellId 30913 19:13:57.041651 tst mo_mt_call_osmux.py: using BVCI 30914 19:13:57.155461 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:57.166861 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:57.178144 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:57.189237 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:57.200297 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:13:57.211515 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:13:57.332482 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:13:57.450592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:57.930446 run create_hlr_db(pid=17809): Launched 19:13:58.055758 bus /sierra_2: Setting Powered False 19:13:59.117192 run create_hlr_db(pid=17809): Terminated: ok {rc=0} 19:13:59.569181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17811): Launched 19:13:59.901208 run osmo-hlr_10.42.42.2(pid=17812): Launched 19:14:00.026954 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:00.599210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17814): Launched 19:14:00.938387 run osmo-stp_10.42.42.5(pid=17815): Launched 19:14:01.244726 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:01.865665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17817): Launched 19:14:02.202589 run osmo-msc_10.42.42.6(pid=17818): Launched 19:14:02.411333 run osmo-stp_10.42.42.5(pid=17815): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17815)] 19:14:02.544014 run osmo-stp_10.42.42.5(pid=17815): stdout: | (launched: 2022-12-12_19:14:00.875127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:02.687881 run osmo-stp_10.42.42.5(pid=17815): stderr: | 20221212191401115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191401115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191401115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191401116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191401118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191401118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191401118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:02.826236 run osmo-stp_10.42.42.5(pid=17815): stdout: | (launched: 2022-12-12_19:14:00.875127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:02.956877 run osmo-stp_10.42.42.5(pid=17815): stderr: | 20221212191401115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191401115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191401115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191401116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191401118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191401118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191401118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:03.113741 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17815): Process ended prematurely: osmo-stp_10.42.42.5(pid=17815) [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17815)] [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:14:03.123424 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 19:14:03.152180 run osmo-hlr_10.42.42.2(pid=17812): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17812)] 19:14:03.203037 run osmo-hlr_10.42.42.2(pid=17812): stdout: | (launched: 2022-12-12_19:13:59.839423) 19:14:03.255941 run osmo-hlr_10.42.42.2(pid=17812): stderr: | 20221212191400044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191400044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191400044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191400044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191400044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191400044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191400057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191400065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191400065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191400066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:03.329475 run osmo-msc_10.42.42.6(pid=17818): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17818)] 19:14:03.380230 run osmo-msc_10.42.42.6(pid=17818): stdout: | (launched: 2022-12-12_19:14:02.139989) 19:14:03.432752 run osmo-msc_10.42.42.6(pid=17818): stderr: | 20221212191402534 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191402534 DLGLOBAL DEBUG validating counter group 0x7f93a3483c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191402534 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191402534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191402535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191402535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191402536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191402537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191402537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191402537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:03.485729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17811): Terminating (SIGTERM) 19:14:03.527965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17814): Terminating (SIGTERM) 19:14:03.570545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17817): Terminating (SIGTERM) 19:14:03.613831 --- ParallelTerminationStrategy: PID 17811 died... 19:14:03.634159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17811): Terminated: ok {rc=0} 19:14:03.681661 --- ParallelTerminationStrategy: PID 17814 died... 19:14:03.701471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17814): Terminated: ok {rc=0} 19:14:03.748670 --- ParallelTerminationStrategy: PID 17817 died... 19:14:03.768613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17817): Terminated: ok {rc=0} 19:14:03.857355 bus /sierra_3: Setting Powered False 19:14:04.957221 bus /sierra_3: Setting Powered False 19:14:06.074757 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:14:07.312005 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:07.317654 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:14:07.338283 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:14:07.365662 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:14:07.419005 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:14:07.440005 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:14:07.466333 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:14:08.015257 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:14:08.064229 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:08.075238 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:14:08.131962 tst mo_mt_call.py: using LAC 30914 19:14:08.253630 tst mo_mt_call.py: using RAC 59 19:14:08.376251 tst mo_mt_call.py: using CellId 30914 19:14:08.498607 tst mo_mt_call.py: using BVCI 30915 19:14:08.610758 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:08.621812 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:08.632438 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:08.643106 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:08.653782 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:08.664489 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:14:08.783685 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:14:08.904152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:09.381516 run create_hlr_db(pid=17823): Launched 19:14:09.507902 bus /sierra_2: Setting Powered False 19:14:10.572160 run create_hlr_db(pid=17823): Terminated: ok {rc=0} 19:14:11.013997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17825): Launched 19:14:11.321671 run osmo-hlr_10.42.42.2(pid=17826): Launched 19:14:11.438532 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:11.985373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17828): Launched 19:14:12.295357 run osmo-stp_10.42.42.5(pid=17829): Launched 19:14:12.412609 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:12.987328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17832): Launched 19:14:13.297334 run osmo-msc_10.42.42.6(pid=17833): Launched 19:14:13.469768 run osmo-stp_10.42.42.5(pid=17829): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17829)] 19:14:13.600427 run osmo-stp_10.42.42.5(pid=17829): stdout: | (launched: 2022-12-12_19:14:12.236558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:13.730167 run osmo-stp_10.42.42.5(pid=17829): stderr: | 20221212191412412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191412413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191412413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191412413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191412414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191412414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191412414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:13.859233 run osmo-stp_10.42.42.5(pid=17829): stdout: | (launched: 2022-12-12_19:14:12.236558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:13.981550 run osmo-stp_10.42.42.5(pid=17829): stderr: | 20221212191412412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191412413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191412413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191412413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191412414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191412414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191412414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:14.128054 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17829): Process ended prematurely: osmo-stp_10.42.42.5(pid=17829) [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17829)] [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:14:14.137129 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:14:14.163746 run osmo-hlr_10.42.42.2(pid=17826): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17826)] 19:14:14.211808 run osmo-hlr_10.42.42.2(pid=17826): stdout: | (launched: 2022-12-12_19:14:11.263756) 19:14:14.261704 run osmo-hlr_10.42.42.2(pid=17826): stderr: | 20221212191411445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191411445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191411445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191411445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191411445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191411445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191411458 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191411467 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191411467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191411467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:14.331189 run osmo-msc_10.42.42.6(pid=17833): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17833)] 19:14:14.379018 run osmo-msc_10.42.42.6(pid=17833): stdout: | (launched: 2022-12-12_19:14:13.238414) 19:14:14.428478 run osmo-msc_10.42.42.6(pid=17833): stderr: | 20221212191413513 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191413513 DLGLOBAL DEBUG validating counter group 0x7f641955bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191413513 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191413513 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191413514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191413514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191413515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191413516 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191413516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191413516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:14.478264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17825): Terminating (SIGTERM) 19:14:14.517973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17828): Terminating (SIGTERM) 19:14:14.557747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17832): Terminating (SIGTERM) 19:14:14.597795 --- ParallelTerminationStrategy: PID 17825 died... 19:14:14.617106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17825): Terminated: ok {rc=0} 19:14:14.661480 --- ParallelTerminationStrategy: PID 17828 died... 19:14:14.680062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17828): Terminated: ok {rc=0} 19:14:14.724239 --- ParallelTerminationStrategy: PID 17832 died... 19:14:14.742911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17832): Terminated: ok {rc=0} 19:14:14.827871 bus /sierra_3: Setting Powered False 19:14:15.936644 bus /sierra_3: Setting Powered False 19:14:17.066068 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:14:18.224816 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:18.236501 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:14:18.293448 tst mo_mt_call_osmux.py: using LAC 30915 19:14:18.415328 tst mo_mt_call_osmux.py: using RAC 60 19:14:18.535942 tst mo_mt_call_osmux.py: using CellId 30915 19:14:18.657603 tst mo_mt_call_osmux.py: using BVCI 30916 19:14:18.768429 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:18.779477 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:18.790476 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:18.801236 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:18.812117 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:14:18.823041 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:14:18.942789 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:14:19.059739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:19.573622 run create_hlr_db(pid=17835): Launched 19:14:19.700125 bus /sierra_2: Setting Powered False 19:14:20.764706 run create_hlr_db(pid=17835): Terminated: ok {rc=0} 19:14:21.224356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17837): Launched 19:14:21.556092 run osmo-hlr_10.42.42.2(pid=17838): Launched 19:14:21.682840 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:22.251086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17840): Launched 19:14:22.581301 run osmo-stp_10.42.42.5(pid=17841): Launched 19:14:22.707643 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:23.306756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17843): Launched 19:14:23.637783 run osmo-msc_10.42.42.6(pid=17844): Launched 19:14:23.822889 run osmo-stp_10.42.42.5(pid=17841): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17841)] 19:14:23.961941 run osmo-stp_10.42.42.5(pid=17841): stdout: | (launched: 2022-12-12_19:14:22.519595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:24.101165 run osmo-stp_10.42.42.5(pid=17841): stderr: | 20221212191422712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191422712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191422713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191422713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191422715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191422715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191422715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:24.239475 run osmo-stp_10.42.42.5(pid=17841): stdout: | (launched: 2022-12-12_19:14:22.519595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:24.371181 run osmo-stp_10.42.42.5(pid=17841): stderr: | 20221212191422712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191422712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191422713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191422713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191422715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191422715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191422715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:24.528107 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17841): Process ended prematurely: osmo-stp_10.42.42.5(pid=17841) [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17841)] [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:14:24.537881 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:14:24.566479 run osmo-hlr_10.42.42.2(pid=17838): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17838)] 19:14:24.617994 run osmo-hlr_10.42.42.2(pid=17838): stdout: | (launched: 2022-12-12_19:14:21.494283) 19:14:24.671241 run osmo-hlr_10.42.42.2(pid=17838): stderr: | 20221212191421696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191421696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191421696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191421697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191421697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191421697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191421709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191421718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191421718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191421718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:24.745132 run osmo-msc_10.42.42.6(pid=17844): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17844)] 19:14:24.796334 run osmo-msc_10.42.42.6(pid=17844): stdout: | (launched: 2022-12-12_19:14:23.575613) 19:14:24.849230 run osmo-msc_10.42.42.6(pid=17844): stderr: | 20221212191423901 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191423901 DLGLOBAL DEBUG validating counter group 0x7fcf21e64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191423901 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191423902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191423902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191423902 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191423903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191423904 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191423904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191423904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:24.902613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17837): Terminating (SIGTERM) 19:14:24.945170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17840): Terminating (SIGTERM) 19:14:24.987911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17843): Terminating (SIGTERM) 19:14:25.030998 --- ParallelTerminationStrategy: PID 17837 died... 19:14:25.051333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17837): Terminated: ok {rc=0} 19:14:25.099369 --- ParallelTerminationStrategy: PID 17840 died... 19:14:25.119216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17840): Terminated: ok {rc=0} 19:14:25.166577 --- ParallelTerminationStrategy: PID 17843 died... 19:14:25.186306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17843): Terminated: ok {rc=0} 19:14:25.275798 bus /sierra_3: Setting Powered False 19:14:26.375451 bus /sierra_3: Setting Powered False 19:14:27.491877 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:sysmo --------------------------------------------------------------------- 19:14:28.725569 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:28.729950 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 19:14:28.750560 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 19:14:28.777062 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 19:14:28.862633 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 19:14:28.883148 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 19:14:28.909629 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 19:14:29.491824 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 19:14:29.496686 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:29.507351 tst emergency:sysmo: Using 1 x bts (candidates: 1) 19:14:29.542256 tst emergency_mo_mt_call.py: using LAC 30916 19:14:29.663563 tst emergency_mo_mt_call.py: using RAC 61 19:14:29.783139 tst emergency_mo_mt_call.py: using CellId 30916 19:14:29.902720 tst emergency_mo_mt_call.py: using BVCI 30917 19:14:30.014264 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:30.024854 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:30.035466 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:30.045944 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:30.056370 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:30.066894 tst emergency:sysmo: Using 1 x modem (candidates: 4) 19:14:30.185983 tst emergency:sysmo: Using 1 x modem (candidates: 4) 19:14:30.305372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:30.776765 run create_hlr_db(pid=17851): Launched 19:14:30.943505 bus /sierra_2: Setting Powered False 19:14:32.021995 run create_hlr_db(pid=17851): Terminated: ok {rc=0} 19:14:32.514191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17853): Launched 19:14:32.840073 run osmo-hlr_10.42.42.2(pid=17854): Launched 19:14:32.963390 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:33.527993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17856): Launched 19:14:33.853992 run osmo-stp_10.42.42.5(pid=17857): Launched 19:14:33.990630 tst emergency_mo_mt_call.py: using MSISDN 7930 19:14:34.163367 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:34.752303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17863): Launched 19:14:35.077772 run osmo-msc_10.42.42.6(pid=17864): Launched 19:14:35.258152 run osmo-stp_10.42.42.5(pid=17857): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17857)] 19:14:35.394762 run osmo-stp_10.42.42.5(pid=17857): stdout: | (launched: 2022-12-12_19:14:33.792594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:35.531547 run osmo-stp_10.42.42.5(pid=17857): stderr: | 20221212191433991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191433991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191433991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191433992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191433993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191433993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191433993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:35.667664 run osmo-stp_10.42.42.5(pid=17857): stdout: | (launched: 2022-12-12_19:14:33.792594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:35.796864 run osmo-stp_10.42.42.5(pid=17857): stderr: | 20221212191433991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191433991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191433991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191433992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191433993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191433993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191433993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:35.952182 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17857): Process ended prematurely: osmo-stp_10.42.42.5(pid=17857) [trial-2381↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17857)] [trial-2381↪emergency:sysmo↪emergency_mo_mt_call.py:19] 19:14:35.961584 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 19:14:35.990802 run osmo-hlr_10.42.42.2(pid=17854): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17854)] 19:14:36.042840 run osmo-hlr_10.42.42.2(pid=17854): stdout: | (launched: 2022-12-12_19:14:32.779136) 19:14:36.095826 run osmo-hlr_10.42.42.2(pid=17854): stderr: | 20221212191432979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191432979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191432979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191432980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191432980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191432980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191432991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191432999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191433000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191433000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:36.169852 run osmo-msc_10.42.42.6(pid=17864): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17864)] 19:14:36.221211 run osmo-msc_10.42.42.6(pid=17864): stdout: | (launched: 2022-12-12_19:14:35.016715) 19:14:36.274567 run osmo-msc_10.42.42.6(pid=17864): stderr: | 20221212191435341 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191435341 DLGLOBAL DEBUG validating counter group 0x7fde694b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191435341 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191435341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191435341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191435342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191435344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191435344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191435344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191435344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:36.328133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17853): Terminating (SIGTERM) 19:14:36.370868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17856): Terminating (SIGTERM) 19:14:36.413610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17863): Terminating (SIGTERM) 19:14:36.456572 --- ParallelTerminationStrategy: PID 17853 died... 19:14:36.477072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17853): Terminated: ok {rc=0} 19:14:36.524636 --- ParallelTerminationStrategy: PID 17856 died... 19:14:36.544504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17856): Terminated: ok {rc=0} 19:14:36.591985 --- ParallelTerminationStrategy: PID 17863 died... 19:14:36.611795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17863): Terminated: ok {rc=0} 19:14:36.701467 bus /sierra_3: Setting Powered False 19:14:37.801864 bus /sierra_3: Setting Powered False 19:14:38.921158 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 19:14:40.009697 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:40.021575 tst emergency:sysmo: Using 1 x bts (candidates: 1) 19:14:40.060535 tst emergency_preemptive_call.py: using LAC 30917 19:14:40.189272 tst emergency_preemptive_call.py: using RAC 62 19:14:40.315636 tst emergency_preemptive_call.py: using CellId 30917 19:14:40.434469 tst emergency_preemptive_call.py: using BVCI 30918 19:14:40.543683 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:40.554447 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:40.565361 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:40.576043 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:40.586775 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 19:14:40.597254 tst emergency:sysmo: Using 1 x modem (candidates: 4) 19:14:40.714803 tst emergency:sysmo: Using 1 x modem (candidates: 4) 19:14:40.837933 tst emergency:sysmo: Using 1 x modem (candidates: 4) 19:14:40.956691 tst emergency:sysmo: Using 1 x modem (candidates: 4) 19:14:41.076727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:41.582893 run create_hlr_db(pid=17866): Launched 19:14:41.707377 bus /sierra_2: Setting Powered False 19:14:42.771292 run create_hlr_db(pid=17866): Terminated: ok {rc=0} 19:14:43.206997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17868): Launched 19:14:43.512287 run osmo-hlr_10.42.42.2(pid=17869): Launched 19:14:43.627403 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:44.154972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Launched 19:14:44.458616 run osmo-stp_10.42.42.5(pid=17872): Launched 19:14:44.581746 tst emergency_preemptive_call.py: using MSISDN 7931 19:14:44.734210 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:45.278571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17874): Launched 19:14:45.582590 run osmo-msc_10.42.42.6(pid=17875): Launched 19:14:45.757904 run osmo-stp_10.42.42.5(pid=17872): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17872)] 19:14:45.969479 run osmo-stp_10.42.42.5(pid=17872): stdout: | (launched: 2022-12-12_19:14:44.400767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:46.098876 run osmo-stp_10.42.42.5(pid=17872): stderr: | 20221212191444572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191444572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191444572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191444573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191444573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191444573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191444573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:46.231575 run osmo-stp_10.42.42.5(pid=17872): stdout: | (launched: 2022-12-12_19:14:44.400767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:46.353673 run osmo-stp_10.42.42.5(pid=17872): stderr: | 20221212191444572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191444572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191444572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191444573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191444573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191444573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191444573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:46.500155 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17872): Process ended prematurely: osmo-stp_10.42.42.5(pid=17872) [trial-2381↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17872)] [trial-2381↪emergency:sysmo↪emergency_preemptive_call.py:32] 19:14:46.509645 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 19:14:46.536909 run osmo-hlr_10.42.42.2(pid=17869): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17869)] 19:14:46.586376 run osmo-hlr_10.42.42.2(pid=17869): stdout: | (launched: 2022-12-12_19:14:43.454403) 19:14:46.637516 run osmo-hlr_10.42.42.2(pid=17869): stderr: | 20221212191443632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191443632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191443632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191443632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191443632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191443632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191443647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191443656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191443656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191443656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:46.708113 run osmo-msc_10.42.42.6(pid=17875): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17875)] 19:14:46.756905 run osmo-msc_10.42.42.6(pid=17875): stdout: | (launched: 2022-12-12_19:14:45.524074) 19:14:46.807421 run osmo-msc_10.42.42.6(pid=17875): stderr: | 20221212191445797 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191445797 DLGLOBAL DEBUG validating counter group 0x7fd30815cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191445797 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191445797 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191445797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191445798 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191445799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191445800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191445800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191445800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:46.858469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17868): Terminating (SIGTERM) 19:14:46.899281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Terminating (SIGTERM) 19:14:46.939994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17874): Terminating (SIGTERM) 19:14:46.981827 --- ParallelTerminationStrategy: PID 17868 died... 19:14:47.001201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17868): Terminated: ok {rc=0} 19:14:47.048259 --- ParallelTerminationStrategy: PID 17871 died... 19:14:47.067726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Terminated: ok {rc=0} 19:14:47.112696 --- ParallelTerminationStrategy: PID 17874 died... 19:14:47.132051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17874): Terminated: ok {rc=0} 19:14:47.218269 bus /sierra_9: Setting Powered False 19:14:48.313500 bus /sierra_9: Setting Powered False 19:14:49.428770 bus /sierra_8: Setting Powered False 19:14:50.528065 bus /sierra_8: Setting Powered False 19:14:51.641622 bus /sierra_3: Setting Powered False 19:14:52.740814 bus /sierra_3: Setting Powered False 19:14:53.858596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:sysmo --------------------------------------------------------------------- 19:14:55.114954 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:55.119200 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 19:14:55.139911 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 19:14:55.178430 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 19:14:55.264801 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 19:14:55.285737 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 19:14:55.323682 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 19:14:55.912347 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 19:14:55.963665 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:55.974270 tst gprs:sysmo: Using 1 x bts (candidates: 1) 19:14:56.009381 tst cs_paging_gprs_active.py: using LAC 30918 19:14:56.131970 tst cs_paging_gprs_active.py: using RAC 63 19:14:56.260322 tst cs_paging_gprs_active.py: using CellId 30918 19:14:56.394087 tst cs_paging_gprs_active.py: using BVCI 30919 19:14:56.515784 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.527042 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.538228 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.549602 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.560752 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.572084 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.583301 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.596821 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:14:56.607927 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:14:56.729485 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:14:56.847471 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:14:57.056765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:14:57.372136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17880): Launched 19:14:57.644739 run iperf3-srv_10.42.42.10(pid=17881): Launched 19:14:57.760716 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:14:57.967075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:14:58.279582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17882): Launched 19:14:58.550645 run iperf3-srv_10.42.42.10(pid=17883): Launched 19:14:58.666220 tst cs_paging_gprs_active.py:38: start network... 19:14:58.872824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:59.354373 run create_hlr_db(pid=17884): Launched 19:14:59.482455 bus /sierra_2: Setting Powered False 19:15:00.543326 run create_hlr_db(pid=17884): Terminated: ok {rc=0} 19:15:01.018895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17887): Launched 19:15:01.374708 run osmo-hlr_10.42.42.2(pid=17888): Launched 19:15:01.677009 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:02.364398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17893): Launched 19:15:02.689323 run osmo-stp_10.42.42.5(pid=17894): Launched 19:15:02.806612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:15:04.335258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17896): Launched 19:15:04.453903 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:15:04.716937 run patchelf(pid=17897): Launched 19:15:04.890595 run osmo-stp_10.42.42.5(pid=17894): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17894)] 19:15:05.021475 run osmo-stp_10.42.42.5(pid=17894): stdout: | (launched: 2022-12-12_19:15:02.630492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:05.154074 run osmo-stp_10.42.42.5(pid=17894): stderr: | 20221212191502805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191502806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191502806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191502806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191502807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191502807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191502807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:05.286386 run osmo-stp_10.42.42.5(pid=17894): stdout: | (launched: 2022-12-12_19:15:02.630492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:05.412539 run osmo-stp_10.42.42.5(pid=17894): stderr: | 20221212191502805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191502806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191502806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191502806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191502807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191502807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191502807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:05.562529 run patchelf(pid=17897): Terminating (SIGINT) 19:15:05.736069 run patchelf(pid=17897): Terminated: ok {rc=0} 19:15:05.860881 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17894): Process ended prematurely: osmo-stp_10.42.42.5(pid=17894) [trial-2381↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17894)] [trial-2381↪gprs:sysmo↪cs_paging_gprs_active.py:38] 19:15:05.870327 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 19:15:05.897718 run osmo-hlr_10.42.42.2(pid=17888): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17888)] 19:15:05.946186 run osmo-hlr_10.42.42.2(pid=17888): stdout: | (launched: 2022-12-12_19:15:01.307938) 19:15:05.996476 run osmo-hlr_10.42.42.2(pid=17888): stderr: | 20221212191501670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191501670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191501670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191501670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191501670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191501670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191501695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191501716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191501716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191501719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:06.047168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17880): Terminating (SIGTERM) 19:15:06.087498 run iperf3-srv_10.42.42.10(pid=17881): Terminating (SIGTERM) 19:15:06.127694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17882): Terminating (SIGTERM) 19:15:06.167984 run iperf3-srv_10.42.42.10(pid=17883): Terminating (SIGTERM) 19:15:06.208050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17887): Terminating (SIGTERM) 19:15:06.248299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17893): Terminating (SIGTERM) 19:15:06.289127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17896): Terminating (SIGTERM) 19:15:06.329597 --- ParallelTerminationStrategy: PID 17880 died... 19:15:06.348833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17880): Terminated: ok {rc=0} 19:15:06.393668 --- ParallelTerminationStrategy: PID 17881 died... 19:15:06.412363 run iperf3-srv_10.42.42.10(pid=17881): Terminated {rc=256} 19:15:06.457599 --- ParallelTerminationStrategy: PID 17882 died... 19:15:06.476453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17882): Terminated: ok {rc=0} 19:15:06.521048 --- ParallelTerminationStrategy: PID 17883 died... 19:15:06.539793 run iperf3-srv_10.42.42.10(pid=17883): Terminated {rc=256} 19:15:06.584253 --- ParallelTerminationStrategy: PID 17887 died... 19:15:06.602998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17887): Terminated: ok {rc=0} 19:15:06.647206 --- ParallelTerminationStrategy: PID 17893 died... 19:15:06.665933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17893): Terminated: ok {rc=0} 19:15:06.711627 --- ParallelTerminationStrategy: PID 17896 died... 19:15:06.730596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17896): Terminated: ok {rc=0} 19:15:06.816672 bus /gobi_0: Setting Powered False 19:15:07.919582 bus /gobi_0: Setting Powered False 19:15:09.038365 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo iperf3.py ---------------------------------------------- 19:15:10.188575 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.200287 tst gprs:sysmo: Using 1 x bts (candidates: 1) 19:15:10.236942 tst iperf3.py: using LAC 30919 19:15:10.359886 tst iperf3.py: using RAC 64 19:15:10.481798 tst iperf3.py: using CellId 30919 19:15:10.603907 tst iperf3.py: using BVCI 30920 19:15:10.716827 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.727434 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.737999 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.748416 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.758890 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.769283 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.779710 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.790145 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:10.800554 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:15:10.915365 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:15:11.122246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:15:11.433724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17898): Launched 19:15:11.704351 run iperf3-srv_10.42.42.10(pid=17899): Launched 19:15:11.820175 tst iperf3.py:8: start network... 19:15:12.026110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:12.506955 run create_hlr_db(pid=17900): Launched 19:15:12.633108 bus /gobi_6: Setting Powered False 19:15:13.694116 run create_hlr_db(pid=17900): Terminated: ok {rc=0} 19:15:14.125649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17902): Launched 19:15:14.436531 run osmo-hlr_10.42.42.2(pid=17903): Launched 19:15:14.552828 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:15.088051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17905): Launched 19:15:15.397396 run osmo-stp_10.42.42.5(pid=17906): Launched 19:15:15.514398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:15:16.067530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17908): Launched 19:15:16.196313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:15:16.473698 run patchelf(pid=17909): Launched 19:15:16.654521 run osmo-stp_10.42.42.5(pid=17906): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17906)] 19:15:16.787000 run osmo-stp_10.42.42.5(pid=17906): stdout: | (launched: 2022-12-12_19:15:15.338479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:16.922398 run osmo-stp_10.42.42.5(pid=17906): stderr: | 20221212191515507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191515507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191515508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191515508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191515509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191515509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191515509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:17.056712 run osmo-stp_10.42.42.5(pid=17906): stdout: | (launched: 2022-12-12_19:15:15.338479) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:17.185074 run osmo-stp_10.42.42.5(pid=17906): stderr: | 20221212191515507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191515507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191515508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191515508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191515509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191515509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191515509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:17.335568 run patchelf(pid=17909): Terminating (SIGINT) 19:15:17.507505 run patchelf(pid=17909): Terminated: ok {rc=0} 19:15:17.631847 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17906): Process ended prematurely: osmo-stp_10.42.42.5(pid=17906) [trial-2381↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17906)] [trial-2381↪gprs:sysmo↪iperf3.py:8] 19:15:17.641341 tst iperf3.py:8: Test FAILED (7.5 sec) 19:15:17.668664 run osmo-hlr_10.42.42.2(pid=17903): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17903)] 19:15:17.717061 run osmo-hlr_10.42.42.2(pid=17903): stdout: | (launched: 2022-12-12_19:15:14.377715) 19:15:17.767223 run osmo-hlr_10.42.42.2(pid=17903): stderr: | 20221212191514554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191514554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191514554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191514554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191514554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191514554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191514566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191514577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191514577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191514577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:17.817991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17898): Terminating (SIGTERM) 19:15:17.858102 run iperf3-srv_10.42.42.10(pid=17899): Terminating (SIGTERM) 19:15:17.898113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17902): Terminating (SIGTERM) 19:15:17.938343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17905): Terminating (SIGTERM) 19:15:17.978481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17908): Terminating (SIGTERM) 19:15:18.018805 --- ParallelTerminationStrategy: PID 17898 died... 19:15:18.038170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17898): Terminated: ok {rc=0} 19:15:18.082611 --- ParallelTerminationStrategy: PID 17899 died... 19:15:18.101458 run iperf3-srv_10.42.42.10(pid=17899): Terminated {rc=256} 19:15:18.145717 --- ParallelTerminationStrategy: PID 17902 died... 19:15:18.164505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17902): Terminated: ok {rc=0} 19:15:18.208817 --- ParallelTerminationStrategy: PID 17905 died... 19:15:18.228164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17905): Terminated: ok {rc=0} 19:15:18.273289 --- ParallelTerminationStrategy: PID 17908 died... 19:15:18.292039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17908): Terminated: ok {rc=0} 19:15:18.379799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo iperf3m4.py ---------------------------------------------- 19:15:19.530561 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:19.541929 tst gprs:sysmo: Using 1 x bts (candidates: 1) 19:15:19.577243 tst iperf3m4.py: using LAC 30920 19:15:19.707089 tst iperf3m4.py: using RAC 65 19:15:19.834043 tst iperf3m4.py: using CellId 30920 19:15:19.961325 tst iperf3m4.py: using BVCI 30921 19:15:20.081211 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.092605 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.103928 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.115589 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.127147 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.138335 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.149766 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.161068 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:20.172392 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:15:20.290696 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:15:20.414859 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:15:20.532633 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:15:20.648769 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:15:20.855601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:15:21.167333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17910): Launched 19:15:21.438699 run iperf3-srv_10.42.42.10(pid=17911): Launched 19:15:21.554427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:15:21.760565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:15:22.073064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17912): Launched 19:15:22.343959 run iperf3-srv_10.42.42.10(pid=17913): Launched 19:15:22.460279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:15:22.665900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:15:22.977889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17914): Launched 19:15:23.248737 run iperf3-srv_10.42.42.10(pid=17915): Launched 19:15:23.363854 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:15:23.569074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:15:23.880313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17916): Launched 19:15:24.167374 run iperf3-srv_10.42.42.10(pid=17917): Launched 19:15:24.282560 tst iperf3m4.py:8: start network... 19:15:24.489479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:24.968309 run create_hlr_db(pid=17918): Launched 19:15:25.095014 bus /gobi_6: Setting Powered False 19:15:26.156885 run create_hlr_db(pid=17918): Terminated: ok {rc=0} 19:15:26.611512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17920): Launched 19:15:26.943897 run osmo-hlr_10.42.42.2(pid=17921): Launched 19:15:27.068922 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:27.642390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17923): Launched 19:15:27.973573 run osmo-stp_10.42.42.5(pid=17924): Launched 19:15:28.098737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:15:28.670958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17926): Launched 19:15:28.798719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:15:29.080090 run patchelf(pid=17927): Launched 19:15:29.264332 run osmo-stp_10.42.42.5(pid=17924): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17924)] 19:15:29.405201 run osmo-stp_10.42.42.5(pid=17924): stdout: | (launched: 2022-12-12_19:15:27.911158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:29.547667 run osmo-stp_10.42.42.5(pid=17924): stderr: | 20221212191528102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191528102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191528102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191528103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191528103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191528103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191528103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:29.689951 run osmo-stp_10.42.42.5(pid=17924): stdout: | (launched: 2022-12-12_19:15:27.911158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:29.825582 run osmo-stp_10.42.42.5(pid=17924): stderr: | 20221212191528102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191528102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191528102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191528103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191528103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191528103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191528103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:29.986615 run patchelf(pid=17927): Terminating (SIGINT) 19:15:30.171701 run patchelf(pid=17927): Terminated: ok {rc=0} 19:15:30.305892 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17924): Process ended prematurely: osmo-stp_10.42.42.5(pid=17924) [trial-2381↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17924)] [trial-2381↪gprs:sysmo↪iperf3m4.py:8] 19:15:30.316292 tst iperf3m4.py:8: Test FAILED (10.8 sec) 19:15:30.346381 run osmo-hlr_10.42.42.2(pid=17921): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17921)] 19:15:30.398217 run osmo-hlr_10.42.42.2(pid=17921): stdout: | (launched: 2022-12-12_19:15:26.881648) 19:15:30.451875 run osmo-hlr_10.42.42.2(pid=17921): stderr: | 20221212191527079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191527079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191527079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191527079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191527079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191527079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191527096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191527105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191527105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191527105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:30.506052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17910): Terminating (SIGTERM) 19:15:30.549270 run iperf3-srv_10.42.42.10(pid=17911): Terminating (SIGTERM) 19:15:30.593249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17912): Terminating (SIGTERM) 19:15:30.636470 run iperf3-srv_10.42.42.10(pid=17913): Terminating (SIGTERM) 19:15:30.679706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17914): Terminating (SIGTERM) 19:15:30.722804 run iperf3-srv_10.42.42.10(pid=17915): Terminating (SIGTERM) 19:15:30.765946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17916): Terminating (SIGTERM) 19:15:30.808880 run iperf3-srv_10.42.42.10(pid=17917): Terminating (SIGTERM) 19:15:30.862412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17920): Terminating (SIGTERM) 19:15:30.920192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17923): Terminating (SIGTERM) 19:15:30.968180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17926): Terminating (SIGTERM) 19:15:31.023870 --- ParallelTerminationStrategy: PID 17910 died... 19:15:31.044634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17910): Terminated: ok {rc=0} 19:15:31.093909 --- ParallelTerminationStrategy: PID 17911 died... 19:15:31.114598 run iperf3-srv_10.42.42.10(pid=17911): Terminated {rc=256} 19:15:31.163526 --- ParallelTerminationStrategy: PID 17912 died... 19:15:31.184340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17912): Terminated: ok {rc=0} 19:15:31.233126 --- ParallelTerminationStrategy: PID 17913 died... 19:15:31.253780 run iperf3-srv_10.42.42.10(pid=17913): Terminated {rc=256} 19:15:31.303139 --- ParallelTerminationStrategy: PID 17914 died... 19:15:31.323845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17914): Terminated: ok {rc=0} 19:15:31.373030 --- ParallelTerminationStrategy: PID 17915 died... 19:15:31.393669 run iperf3-srv_10.42.42.10(pid=17915): Terminated {rc=256} 19:15:31.442852 --- ParallelTerminationStrategy: PID 17916 died... 19:15:31.463579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17916): Terminated: ok {rc=0} 19:15:31.512461 --- ParallelTerminationStrategy: PID 17917 died... 19:15:31.533250 run iperf3-srv_10.42.42.10(pid=17917): Terminated {rc=256} 19:15:31.582163 --- ParallelTerminationStrategy: PID 17920 died... 19:15:31.602788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17920): Terminated: ok {rc=0} 19:15:31.651644 --- ParallelTerminationStrategy: PID 17923 died... 19:15:31.672423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17923): Terminated: ok {rc=0} 19:15:31.721703 --- ParallelTerminationStrategy: PID 17926 died... 19:15:31.742269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17926): Terminated: ok {rc=0} 19:15:31.847173 bus /gobi_4: Setting Powered False 19:15:32.967908 bus /gobi_4: Setting Powered False 19:15:34.086412 bus /gobi_1: Setting Powered False 19:15:35.187344 bus /gobi_1: Setting Powered False 19:15:36.306411 bus /gobi_0: Setting Powered False 19:15:37.402758 bus /gobi_0: Setting Powered False 19:15:38.518071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo ping.py ---------------------------------------------- 19:15:39.622784 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:39.634659 tst gprs:sysmo: Using 1 x bts (candidates: 1) 19:15:39.672383 tst ping.py: using LAC 30921 19:15:39.793808 tst ping.py: using RAC 66 19:15:39.913698 tst ping.py: using CellId 30921 19:15:40.036675 tst ping.py: using BVCI 30922 19:15:40.148811 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:40.159593 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:40.170481 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:40.181738 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:40.192585 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:40.204106 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:40.215491 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:40.226773 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:15:40.347215 tst ping.py:19: start network... 19:15:40.567044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:41.074107 run create_hlr_db(pid=17928): Launched 19:15:41.199673 bus /gobi_6: Setting Powered False 19:15:42.264050 run create_hlr_db(pid=17928): Terminated: ok {rc=0} 19:15:42.703160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17930): Launched 19:15:43.009846 run osmo-hlr_10.42.42.2(pid=17931): Launched 19:15:43.125219 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:43.648726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17933): Launched 19:15:43.954586 run osmo-stp_10.42.42.5(pid=17934): Launched 19:15:44.071023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:15:44.594785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17936): Launched 19:15:44.710352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:15:44.968171 run patchelf(pid=17937): Launched 19:15:45.143604 run osmo-stp_10.42.42.5(pid=17934): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17934)] 19:15:45.272297 run osmo-stp_10.42.42.5(pid=17934): stdout: | (launched: 2022-12-12_19:15:43.896685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:45.402725 run osmo-stp_10.42.42.5(pid=17934): stderr: | 20221212191544065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191544065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191544066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191544066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191544067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191544067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191544067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:45.532902 run osmo-stp_10.42.42.5(pid=17934): stdout: | (launched: 2022-12-12_19:15:43.896685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:45.657561 run osmo-stp_10.42.42.5(pid=17934): stderr: | 20221212191544065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191544065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191544066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191544066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191544067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191544067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191544067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:45.804318 run patchelf(pid=17937): Terminating (SIGINT) 19:15:45.987823 run patchelf(pid=17937): Terminated: ok {rc=0} 19:15:46.111996 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17934): Process ended prematurely: osmo-stp_10.42.42.5(pid=17934) [trial-2381↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17934)] [trial-2381↪gprs:sysmo↪ping.py:22] 19:15:46.122141 tst ping.py:22: Test FAILED (6.5 sec) 19:15:46.150201 run osmo-hlr_10.42.42.2(pid=17931): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17931)] 19:15:46.199796 run osmo-hlr_10.42.42.2(pid=17931): stdout: | (launched: 2022-12-12_19:15:42.952119) 19:15:46.250824 run osmo-hlr_10.42.42.2(pid=17931): stderr: | 20221212191543127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191543127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191543127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191543127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191543127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191543127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191543139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191543148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191543148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191543148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:46.302720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17930): Terminating (SIGTERM) 19:15:46.344089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17933): Terminating (SIGTERM) 19:15:46.385509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17936): Terminating (SIGTERM) 19:15:46.426970 --- ParallelTerminationStrategy: PID 17930 died... 19:15:46.446641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17930): Terminated: ok {rc=0} 19:15:46.492448 --- ParallelTerminationStrategy: PID 17933 died... 19:15:46.512122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17933): Terminated: ok {rc=0} 19:15:46.557920 --- ParallelTerminationStrategy: PID 17936 died... 19:15:46.578167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17936): Terminated: ok {rc=0} 19:15:46.666465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 19:15:47.754624 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:47.765988 tst gprs:sysmo: Using 1 x bts (candidates: 1) 19:15:47.802666 tst ping_idle_ping.py: using LAC 30922 19:15:47.935665 tst ping_idle_ping.py: using RAC 67 19:15:48.053602 tst ping_idle_ping.py: using CellId 30922 19:15:48.170501 tst ping_idle_ping.py: using BVCI 30923 19:15:48.279619 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:48.290357 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:48.301044 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:48.312505 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:48.323543 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:48.334313 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:48.345363 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 19:15:48.356218 tst gprs:sysmo: Using 1 x modem (candidates: 4) 19:15:48.478284 tst ping_idle_ping.py:24: start network... 19:15:48.678854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:49.138645 run create_hlr_db(pid=17938): Launched 19:15:49.259972 bus /gobi_6: Setting Powered False 19:15:50.320449 run create_hlr_db(pid=17938): Terminated: ok {rc=0} 19:15:50.739876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17940): Launched 19:15:51.039063 run osmo-hlr_10.42.42.2(pid=17941): Launched 19:15:51.151521 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:51.665201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17943): Launched 19:15:51.964291 run osmo-stp_10.42.42.5(pid=17944): Launched 19:15:52.076805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:15:52.592857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17946): Launched 19:15:52.708021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:15:52.962003 run patchelf(pid=17947): Launched 19:15:53.128002 run osmo-stp_10.42.42.5(pid=17944): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17944)] 19:15:53.254427 run osmo-stp_10.42.42.5(pid=17944): stdout: | (launched: 2022-12-12_19:15:51.907954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:53.382824 run osmo-stp_10.42.42.5(pid=17944): stderr: | 20221212191552077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191552077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191552077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191552078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191552078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191552078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191552078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:53.510809 run osmo-stp_10.42.42.5(pid=17944): stdout: | (launched: 2022-12-12_19:15:51.907954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:53.632932 run osmo-stp_10.42.42.5(pid=17944): stderr: | 20221212191552077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191552077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191552077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191552078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191552078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191552078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191552078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:53.777960 run patchelf(pid=17947): Terminating (SIGINT) 19:15:53.944580 run patchelf(pid=17947): Terminated: ok {rc=0} 19:15:54.064417 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17944): Process ended prematurely: osmo-stp_10.42.42.5(pid=17944) [trial-2381↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17944)] [trial-2381↪gprs:sysmo↪ping_idle_ping.py:27] 19:15:54.073160 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 19:15:54.099677 run osmo-hlr_10.42.42.2(pid=17941): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17941)] 19:15:54.147222 run osmo-hlr_10.42.42.2(pid=17941): stdout: | (launched: 2022-12-12_19:15:50.982785) 19:15:54.196425 run osmo-hlr_10.42.42.2(pid=17941): stderr: | 20221212191551156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191551156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191551156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191551156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191551156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191551156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191551168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191551177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191551177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191551177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:54.245998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17940): Terminating (SIGTERM) 19:15:54.285474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17943): Terminating (SIGTERM) 19:15:54.324918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17946): Terminating (SIGTERM) 19:15:54.364654 --- ParallelTerminationStrategy: PID 17940 died... 19:15:54.383215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17940): Terminated: ok {rc=0} 19:15:54.427357 --- ParallelTerminationStrategy: PID 17943 died... 19:15:54.446196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17943): Terminated: ok {rc=0} 19:15:54.489981 --- ParallelTerminationStrategy: PID 17946 died... 19:15:54.508644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17946): Terminated: ok {rc=0} 19:15:54.593804 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 19:15:55.876375 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:15:55.881961 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:15:55.902796 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:15:55.942847 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:15:56.029420 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:15:56.049999 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:15:56.087722 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:15:56.680032 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:15:56.729156 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:56.739868 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:15:56.776562 tst cs_paging_gprs_active.py: using LAC 30923 19:15:56.896134 tst cs_paging_gprs_active.py: using RAC 68 19:15:57.016783 tst cs_paging_gprs_active.py: using CellId 30923 19:15:57.136098 tst cs_paging_gprs_active.py: using BVCI 30924 19:15:57.245934 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.256631 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.267148 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.277735 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.288161 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.298646 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.309317 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.319773 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:15:57.330599 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:15:57.447685 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:15:57.567697 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:15:57.789932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:15:58.120243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17953): Launched 19:15:58.408806 run iperf3-srv_10.42.42.10(pid=17954): Launched 19:15:58.531801 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:15:58.753779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:15:59.084330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17955): Launched 19:15:59.373704 run iperf3-srv_10.42.42.10(pid=17956): Launched 19:15:59.496342 tst cs_paging_gprs_active.py:38: start network... 19:15:59.716931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:00.224627 run create_hlr_db(pid=17957): Launched 19:16:00.350400 bus /gobi_6: Setting Powered False 19:16:01.419110 run create_hlr_db(pid=17957): Terminated: ok {rc=0} 19:16:01.885844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17959): Launched 19:16:02.230207 run osmo-hlr_10.42.42.2(pid=17960): Launched 19:16:02.356151 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:02.922383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17962): Launched 19:16:03.252074 run osmo-stp_10.42.42.5(pid=17963): Launched 19:16:03.377557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:16:03.943856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17965): Launched 19:16:04.071890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:16:04.351581 run patchelf(pid=17966): Launched 19:16:04.535735 run osmo-stp_10.42.42.5(pid=17963): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17963)] 19:16:04.675172 run osmo-stp_10.42.42.5(pid=17963): stdout: | (launched: 2022-12-12_19:16:03.190837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:04.816204 run osmo-stp_10.42.42.5(pid=17963): stderr: | 20221212191603379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191603379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191603380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191603380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191603381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191603381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191603381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:04.956724 run osmo-stp_10.42.42.5(pid=17963): stdout: | (launched: 2022-12-12_19:16:03.190837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:05.091285 run osmo-stp_10.42.42.5(pid=17963): stderr: | 20221212191603379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191603379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191603380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191603380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191603381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191603381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191603381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:05.250682 run patchelf(pid=17966): Terminating (SIGINT) 19:16:05.435195 run patchelf(pid=17966): Terminated: ok {rc=0} 19:16:05.568309 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17963): Process ended prematurely: osmo-stp_10.42.42.5(pid=17963) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17963)] [trial-2381↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:16:05.578543 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:16:05.607948 run osmo-hlr_10.42.42.2(pid=17960): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17960)] 19:16:05.658889 run osmo-hlr_10.42.42.2(pid=17960): stdout: | (launched: 2022-12-12_19:16:02.167745) 19:16:05.711703 run osmo-hlr_10.42.42.2(pid=17960): stderr: | 20221212191602363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191602363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191602363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191602363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191602363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191602363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191602379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191602388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191602388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191602388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:05.764918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17953): Terminating (SIGTERM) 19:16:05.807855 run iperf3-srv_10.42.42.10(pid=17954): Terminating (SIGTERM) 19:16:05.850508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17955): Terminating (SIGTERM) 19:16:05.893256 run iperf3-srv_10.42.42.10(pid=17956): Terminating (SIGTERM) 19:16:05.935698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17959): Terminating (SIGTERM) 19:16:05.978568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17962): Terminating (SIGTERM) 19:16:06.021440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17965): Terminating (SIGTERM) 19:16:06.064261 --- ParallelTerminationStrategy: PID 17953 died... 19:16:06.084510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17953): Terminated: ok {rc=0} 19:16:06.132390 --- ParallelTerminationStrategy: PID 17954 died... 19:16:06.152142 run iperf3-srv_10.42.42.10(pid=17954): Terminated {rc=256} 19:16:06.199177 --- ParallelTerminationStrategy: PID 17955 died... 19:16:06.218995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17955): Terminated: ok {rc=0} 19:16:06.266163 --- ParallelTerminationStrategy: PID 17956 died... 19:16:06.285835 run iperf3-srv_10.42.42.10(pid=17956): Terminated {rc=256} 19:16:06.333368 --- ParallelTerminationStrategy: PID 17959 died... 19:16:06.352995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17959): Terminated: ok {rc=0} 19:16:06.400723 --- ParallelTerminationStrategy: PID 17962 died... 19:16:06.420586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17962): Terminated: ok {rc=0} 19:16:06.467640 --- ParallelTerminationStrategy: PID 17965 died... 19:16:06.487389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17965): Terminated: ok {rc=0} 19:16:06.577998 bus /gobi_0: Setting Powered False 19:16:07.678699 bus /gobi_0: Setting Powered False 19:16:08.797185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:16:09.947257 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:09.959397 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:16:09.997768 tst iperf3.py: using LAC 30924 19:16:10.117480 tst iperf3.py: using RAC 69 19:16:10.235971 tst iperf3.py: using CellId 30924 19:16:10.355520 tst iperf3.py: using BVCI 30925 19:16:10.467170 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.477941 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.488463 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.499709 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.510823 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.521881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.533580 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.544525 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:10.555757 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:16:10.678355 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:16:10.884169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:11.190571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17967): Launched 19:16:11.456353 run iperf3-srv_10.42.42.10(pid=17968): Launched 19:16:11.570411 tst iperf3.py:8: start network... 19:16:11.773321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:12.244538 run create_hlr_db(pid=17969): Launched 19:16:12.368194 bus /gobi_6: Setting Powered False 19:16:13.428156 run create_hlr_db(pid=17969): Terminated: ok {rc=0} 19:16:13.853048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17971): Launched 19:16:14.159286 run osmo-hlr_10.42.42.2(pid=17972): Launched 19:16:14.275058 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:14.800607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17974): Launched 19:16:15.107091 run osmo-stp_10.42.42.5(pid=17975): Launched 19:16:15.222844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:16:15.751339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17977): Launched 19:16:15.895255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:16:16.160729 run patchelf(pid=17978): Launched 19:16:16.345748 run osmo-stp_10.42.42.5(pid=17975): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17975)] 19:16:16.476929 run osmo-stp_10.42.42.5(pid=17975): stdout: | (launched: 2022-12-12_19:16:15.049342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:16.611199 run osmo-stp_10.42.42.5(pid=17975): stderr: | 20221212191615218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191615219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191615219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191615219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191615220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191615220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191615220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:16.744857 run osmo-stp_10.42.42.5(pid=17975): stdout: | (launched: 2022-12-12_19:16:15.049342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:16.872487 run osmo-stp_10.42.42.5(pid=17975): stderr: | 20221212191615218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191615219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191615219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191615219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191615220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191615220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191615220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:17.030256 run patchelf(pid=17978): Terminating (SIGINT) 19:16:17.219227 run patchelf(pid=17978): Terminated: ok {rc=0} 19:16:17.354442 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17975): Process ended prematurely: osmo-stp_10.42.42.5(pid=17975) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17975)] [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 19:16:17.364880 tst iperf3.py:8: Test FAILED (7.5 sec) 19:16:17.394911 run osmo-hlr_10.42.42.2(pid=17972): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17972)] 19:16:17.447184 run osmo-hlr_10.42.42.2(pid=17972): stdout: | (launched: 2022-12-12_19:16:14.101834) 19:16:17.500672 run osmo-hlr_10.42.42.2(pid=17972): stderr: | 20221212191614276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191614276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191614276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191614276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191614276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191614276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191614292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191614302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191614303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191614303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:17.554965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17967): Terminating (SIGTERM) 19:16:17.598828 run iperf3-srv_10.42.42.10(pid=17968): Terminating (SIGTERM) 19:16:17.642482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17971): Terminating (SIGTERM) 19:16:17.686231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17974): Terminating (SIGTERM) 19:16:17.729879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17977): Terminating (SIGTERM) 19:16:17.773498 --- ParallelTerminationStrategy: PID 17967 died... 19:16:17.794178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17967): Terminated: ok {rc=0} 19:16:17.842876 --- ParallelTerminationStrategy: PID 17968 died... 19:16:17.863021 run iperf3-srv_10.42.42.10(pid=17968): Terminated {rc=256} 19:16:17.910980 --- ParallelTerminationStrategy: PID 17971 died... 19:16:17.931055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17971): Terminated: ok {rc=0} 19:16:17.978474 --- ParallelTerminationStrategy: PID 17974 died... 19:16:17.998591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17974): Terminated: ok {rc=0} 19:16:18.046257 --- ParallelTerminationStrategy: PID 17977 died... 19:16:18.066283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17977): Terminated: ok {rc=0} 19:16:18.155655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:16:19.307420 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.319684 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:16:19.355493 tst iperf3m4.py: using LAC 30925 19:16:19.480532 tst iperf3m4.py: using RAC 70 19:16:19.605923 tst iperf3m4.py: using CellId 30925 19:16:19.731373 tst iperf3m4.py: using BVCI 30926 19:16:19.847764 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.859021 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.870145 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.881527 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.892674 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.903940 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.915328 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.926832 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:19.938473 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:16:20.055114 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:16:20.175915 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:16:20.290639 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:16:20.408381 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:16:20.610856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:20.916581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17979): Launched 19:16:21.182026 run iperf3-srv_10.42.42.10(pid=17980): Launched 19:16:21.295333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:16:21.497304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:21.802144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17981): Launched 19:16:22.066792 run iperf3-srv_10.42.42.10(pid=17982): Launched 19:16:22.179897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:16:22.381591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:22.686277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Launched 19:16:22.951576 run iperf3-srv_10.42.42.10(pid=17984): Launched 19:16:23.064478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:16:23.266148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:23.570437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17985): Launched 19:16:23.834904 run iperf3-srv_10.42.42.10(pid=17986): Launched 19:16:23.948020 tst iperf3m4.py:8: start network... 19:16:24.149767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:24.619309 run create_hlr_db(pid=17987): Launched 19:16:24.744012 bus /gobi_6: Setting Powered False 19:16:25.805168 run create_hlr_db(pid=17987): Terminated: ok {rc=0} 19:16:26.249244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17989): Launched 19:16:26.574730 run osmo-hlr_10.42.42.2(pid=17990): Launched 19:16:26.697771 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:27.262357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17992): Launched 19:16:27.587791 run osmo-stp_10.42.42.5(pid=17993): Launched 19:16:27.711794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:16:28.272850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17995): Launched 19:16:28.397925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:16:28.674391 run patchelf(pid=17996): Launched 19:16:28.864506 run osmo-stp_10.42.42.5(pid=17993): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17993)] 19:16:29.011282 run osmo-stp_10.42.42.5(pid=17993): stdout: | (launched: 2022-12-12_19:16:27.527264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:29.151550 run osmo-stp_10.42.42.5(pid=17993): stderr: | 20221212191627716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191627716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191627716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191627717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191627717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191627717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191627718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:29.291711 run osmo-stp_10.42.42.5(pid=17993): stdout: | (launched: 2022-12-12_19:16:27.527264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:29.425982 run osmo-stp_10.42.42.5(pid=17993): stderr: | 20221212191627716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191627716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191627716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191627717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191627717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191627717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191627718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:29.584465 run patchelf(pid=17996): Terminating (SIGINT) 19:16:29.767143 run patchelf(pid=17996): Terminated: ok {rc=0} 19:16:29.899227 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17993): Process ended prematurely: osmo-stp_10.42.42.5(pid=17993) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17993)] [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 19:16:29.909380 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:16:29.939204 run osmo-hlr_10.42.42.2(pid=17990): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17990)] 19:16:29.990117 run osmo-hlr_10.42.42.2(pid=17990): stdout: | (launched: 2022-12-12_19:16:26.514405) 19:16:30.042711 run osmo-hlr_10.42.42.2(pid=17990): stderr: | 20221212191626711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191626711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191626711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191626711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191626711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191626711 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191626723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191626731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191626732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191626733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:30.096215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17979): Terminating (SIGTERM) 19:16:30.138450 run iperf3-srv_10.42.42.10(pid=17980): Terminating (SIGTERM) 19:16:30.180677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17981): Terminating (SIGTERM) 19:16:30.223569 run iperf3-srv_10.42.42.10(pid=17982): Terminating (SIGTERM) 19:16:30.266342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Terminating (SIGTERM) 19:16:30.308567 run iperf3-srv_10.42.42.10(pid=17984): Terminating (SIGTERM) 19:16:30.351682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17985): Terminating (SIGTERM) 19:16:30.394565 run iperf3-srv_10.42.42.10(pid=17986): Terminating (SIGTERM) 19:16:30.436763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17989): Terminating (SIGTERM) 19:16:30.479253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17992): Terminating (SIGTERM) 19:16:30.521188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17995): Terminating (SIGTERM) 19:16:30.563631 --- ParallelTerminationStrategy: PID 17979 died... 19:16:30.583813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17979): Terminated: ok {rc=0} 19:16:30.631715 --- ParallelTerminationStrategy: PID 17980 died... 19:16:30.651954 run iperf3-srv_10.42.42.10(pid=17980): Terminated {rc=256} 19:16:30.699110 --- ParallelTerminationStrategy: PID 17981 died... 19:16:30.718958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17981): Terminated: ok {rc=0} 19:16:30.766925 --- ParallelTerminationStrategy: PID 17982 died... 19:16:30.786862 run iperf3-srv_10.42.42.10(pid=17982): Terminated {rc=256} 19:16:30.839473 --- ParallelTerminationStrategy: PID 17983 died... 19:16:30.861039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Terminated: ok {rc=0} 19:16:30.928997 --- ParallelTerminationStrategy: PID 17984 died... 19:16:30.949152 run iperf3-srv_10.42.42.10(pid=17984): Terminated {rc=256} 19:16:30.998141 --- ParallelTerminationStrategy: PID 17985 died... 19:16:31.019117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17985): Terminated: ok {rc=0} 19:16:31.079834 --- ParallelTerminationStrategy: PID 17986 died... 19:16:31.102466 run iperf3-srv_10.42.42.10(pid=17986): Terminated {rc=256} 19:16:31.151644 --- ParallelTerminationStrategy: PID 17989 died... 19:16:31.172677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17989): Terminated: ok {rc=0} 19:16:31.221805 --- ParallelTerminationStrategy: PID 17992 died... 19:16:31.242915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17992): Terminated: ok {rc=0} 19:16:31.292554 --- ParallelTerminationStrategy: PID 17995 died... 19:16:31.313681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17995): Terminated: ok {rc=0} 19:16:31.407622 bus /gobi_4: Setting Powered False 19:16:32.510028 bus /gobi_4: Setting Powered False 19:16:33.626990 bus /gobi_1: Setting Powered False 19:16:34.726727 bus /gobi_1: Setting Powered False 19:16:35.843889 bus /gobi_0: Setting Powered False 19:16:36.942331 bus /gobi_0: Setting Powered False 19:16:38.060709 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 19:16:39.165405 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.177584 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:16:39.216573 tst ping.py: using LAC 30926 19:16:39.343650 tst ping.py: using RAC 71 19:16:39.462623 tst ping.py: using CellId 30926 19:16:39.580859 tst ping.py: using BVCI 30927 19:16:39.688931 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.699721 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.710435 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.721091 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.731575 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.742539 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.753244 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:39.763861 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:16:39.884724 tst ping.py:19: start network... 19:16:40.102315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:40.602171 run create_hlr_db(pid=17997): Launched 19:16:40.724626 bus /gobi_6: Setting Powered False 19:16:41.788929 run create_hlr_db(pid=17997): Terminated: ok {rc=0} 19:16:42.239028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17999): Launched 19:16:42.560910 run osmo-hlr_10.42.42.2(pid=18000): Launched 19:16:42.683232 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:43.238792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18002): Launched 19:16:43.559996 run osmo-stp_10.42.42.5(pid=18003): Launched 19:16:43.682964 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:16:44.236477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18005): Launched 19:16:44.359907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:16:44.631804 run patchelf(pid=18006): Launched 19:16:44.810224 run osmo-stp_10.42.42.5(pid=18003): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18003)] 19:16:44.946056 run osmo-stp_10.42.42.5(pid=18003): stdout: | (launched: 2022-12-12_19:16:43.501176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:45.084011 run osmo-stp_10.42.42.5(pid=18003): stderr: | 20221212191643689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191643689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191643689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191643690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191643690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191643690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191643690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:45.221926 run osmo-stp_10.42.42.5(pid=18003): stdout: | (launched: 2022-12-12_19:16:43.501176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:45.354015 run osmo-stp_10.42.42.5(pid=18003): stderr: | 20221212191643689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191643689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191643689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191643690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191643690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191643690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191643690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:45.510575 run patchelf(pid=18006): Terminating (SIGINT) 19:16:45.689697 run patchelf(pid=18006): Terminated: ok {rc=0} 19:16:45.818593 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18003): Process ended prematurely: osmo-stp_10.42.42.5(pid=18003) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18003)] [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 19:16:45.830211 tst ping.py:22: Test FAILED (6.7 sec) 19:16:45.863303 run osmo-hlr_10.42.42.2(pid=18000): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18000)] 19:16:45.927217 run osmo-hlr_10.42.42.2(pid=18000): stdout: | (launched: 2022-12-12_19:16:42.502150) 19:16:45.982477 run osmo-hlr_10.42.42.2(pid=18000): stderr: | 20221212191642697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191642697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191642697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191642697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191642697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191642697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191642710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191642718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191642719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191642719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:46.038248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17999): Terminating (SIGTERM) 19:16:46.083255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18002): Terminating (SIGTERM) 19:16:46.128040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18005): Terminating (SIGTERM) 19:16:46.172665 --- ParallelTerminationStrategy: PID 17999 died... 19:16:46.193751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17999): Terminated: ok {rc=0} 19:16:46.243790 --- ParallelTerminationStrategy: PID 18002 died... 19:16:46.264651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18002): Terminated: ok {rc=0} 19:16:46.315105 --- ParallelTerminationStrategy: PID 18005 died... 19:16:46.336086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18005): Terminated: ok {rc=0} 19:16:46.429138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:16:47.516700 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:47.528468 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:16:47.566677 tst ping_idle_ping.py: using LAC 30927 19:16:47.684599 tst ping_idle_ping.py: using RAC 72 19:16:47.802156 tst ping_idle_ping.py: using CellId 30927 19:16:47.921775 tst ping_idle_ping.py: using BVCI 30928 19:16:48.030513 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:48.041621 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:48.052591 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:48.063666 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:48.074781 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:48.085545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:48.096901 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:16:48.107882 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:16:48.234249 tst ping_idle_ping.py:24: start network... 19:16:48.452532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:48.949184 run create_hlr_db(pid=18007): Launched 19:16:49.072241 bus /gobi_6: Setting Powered False 19:16:50.136420 run create_hlr_db(pid=18007): Terminated: ok {rc=0} 19:16:50.566258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18009): Launched 19:16:50.865869 run osmo-hlr_10.42.42.2(pid=18010): Launched 19:16:50.979159 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:51.494488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18012): Launched 19:16:51.794394 run osmo-stp_10.42.42.5(pid=18013): Launched 19:16:51.908072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:16:52.425058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18015): Launched 19:16:52.540088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:16:52.793411 run patchelf(pid=18016): Launched 19:16:52.959481 run osmo-stp_10.42.42.5(pid=18013): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18013)] 19:16:53.086076 run osmo-stp_10.42.42.5(pid=18013): stdout: | (launched: 2022-12-12_19:16:51.738874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:53.215127 run osmo-stp_10.42.42.5(pid=18013): stderr: | 20221212191651905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191651905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191651905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191651906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191651906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191651906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191651906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:53.343483 run osmo-stp_10.42.42.5(pid=18013): stdout: | (launched: 2022-12-12_19:16:51.738874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:53.465802 run osmo-stp_10.42.42.5(pid=18013): stderr: | 20221212191651905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191651905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191651905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191651906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191651906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191651906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191651906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:53.610643 run patchelf(pid=18016): Terminating (SIGINT) 19:16:53.777453 run patchelf(pid=18016): Terminated: ok {rc=0} 19:16:53.897471 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18013): Process ended prematurely: osmo-stp_10.42.42.5(pid=18013) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18013)] [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 19:16:53.906278 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:16:53.932499 run osmo-hlr_10.42.42.2(pid=18010): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18010)] 19:16:53.980046 run osmo-hlr_10.42.42.2(pid=18010): stdout: | (launched: 2022-12-12_19:16:50.810570) 19:16:54.029578 run osmo-hlr_10.42.42.2(pid=18010): stderr: | 20221212191650983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191650983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191650983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191650983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191650983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191650983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191650996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191651006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191651006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191651006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:54.079410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18009): Terminating (SIGTERM) 19:16:54.119197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18012): Terminating (SIGTERM) 19:16:54.159077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18015): Terminating (SIGTERM) 19:16:54.199432 --- ParallelTerminationStrategy: PID 18009 died... 19:16:54.218753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18009): Terminated: ok {rc=0} 19:16:54.263231 --- ParallelTerminationStrategy: PID 18012 died... 19:16:54.282071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18012): Terminated: ok {rc=0} 19:16:54.326111 --- ParallelTerminationStrategy: PID 18015 died... 19:16:54.344926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18015): Terminated: ok {rc=0} 19:16:54.430966 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:16:55.720232 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:16:55.726557 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:16:55.747088 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:16:55.786032 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:16:55.871343 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:16:55.891838 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:16:55.930434 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:16:56.528888 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:16:56.582238 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:56.593808 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:16:56.653447 tst cs_paging_gprs_active.py: using LAC 30928 19:16:56.773990 tst cs_paging_gprs_active.py: using RAC 73 19:16:56.894797 tst cs_paging_gprs_active.py: using CellId 30928 19:16:57.012774 tst cs_paging_gprs_active.py: using BVCI 30929 19:16:57.123437 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.134812 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.145868 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.157246 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.168246 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.179477 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.190815 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.201955 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:16:57.213294 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:16:57.331621 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:16:57.453234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:16:57.658077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:57.964086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18021): Launched 19:16:58.230083 run iperf3-srv_10.42.42.10(pid=18022): Launched 19:16:58.343790 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:16:58.546758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:16:58.852018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18023): Launched 19:16:59.117279 run iperf3-srv_10.42.42.10(pid=18024): Launched 19:16:59.231659 tst cs_paging_gprs_active.py:38: start network... 19:16:59.434904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:59.906330 run create_hlr_db(pid=18025): Launched 19:17:00.031498 bus /gobi_6: Setting Powered False 19:17:01.091594 run create_hlr_db(pid=18025): Terminated: ok {rc=0} 19:17:01.535625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18027): Launched 19:17:01.868665 run osmo-hlr_10.42.42.2(pid=18029): Launched 19:17:02.022746 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:02.737345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18033): Launched 19:17:03.067812 run osmo-stp_10.42.42.5(pid=18034): Launched 19:17:03.211597 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:03.750291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18036): Launched 19:17:03.867543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:04.126270 run patchelf(pid=18037): Launched 19:17:04.296822 run osmo-stp_10.42.42.5(pid=18034): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18034)] 19:17:04.426737 run osmo-stp_10.42.42.5(pid=18034): stdout: | (launched: 2022-12-12_19:17:03.005107) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:04.558446 run osmo-stp_10.42.42.5(pid=18034): stderr: | 20221212191703198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191703198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191703199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191703199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191703200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191703200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191703200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:04.690462 run osmo-stp_10.42.42.5(pid=18034): stdout: | (launched: 2022-12-12_19:17:03.005107) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:04.814984 run osmo-stp_10.42.42.5(pid=18034): stderr: | 20221212191703198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191703198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191703199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191703199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191703200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191703200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191703200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:04.963153 run patchelf(pid=18037): Terminating (SIGINT) 19:17:05.134787 run patchelf(pid=18037): Terminated: ok {rc=0} 19:17:05.259671 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18034): Process ended prematurely: osmo-stp_10.42.42.5(pid=18034) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18034)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:17:05.269279 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:17:05.296601 run osmo-hlr_10.42.42.2(pid=18029): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18029)] 19:17:05.344502 run osmo-hlr_10.42.42.2(pid=18029): stdout: | (launched: 2022-12-12_19:17:01.801147) 19:17:05.394182 run osmo-hlr_10.42.42.2(pid=18029): stderr: | 20221212191702083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191702083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191702083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191702083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191702083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191702083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191702099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191702122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191702123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191702123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:05.443994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18021): Terminating (SIGTERM) 19:17:05.483955 run iperf3-srv_10.42.42.10(pid=18022): Terminating (SIGTERM) 19:17:05.523702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18023): Terminating (SIGTERM) 19:17:05.563514 run iperf3-srv_10.42.42.10(pid=18024): Terminating (SIGTERM) 19:17:05.603295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18027): Terminating (SIGTERM) 19:17:05.643254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18033): Terminating (SIGTERM) 19:17:05.683003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18036): Terminating (SIGTERM) 19:17:05.723047 --- ParallelTerminationStrategy: PID 18021 died... 19:17:05.742354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18021): Terminated: ok {rc=0} 19:17:05.786438 --- ParallelTerminationStrategy: PID 18022 died... 19:17:05.805280 run iperf3-srv_10.42.42.10(pid=18022): Terminated {rc=256} 19:17:05.849554 --- ParallelTerminationStrategy: PID 18023 died... 19:17:05.868266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18023): Terminated: ok {rc=0} 19:17:05.911981 --- ParallelTerminationStrategy: PID 18024 died... 19:17:05.930580 run iperf3-srv_10.42.42.10(pid=18024): Terminated {rc=256} 19:17:05.975061 --- ParallelTerminationStrategy: PID 18027 died... 19:17:05.993810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18027): Terminated: ok {rc=0} 19:17:06.037704 --- ParallelTerminationStrategy: PID 18033 died... 19:17:06.056316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18033): Terminated: ok {rc=0} 19:17:06.100940 --- ParallelTerminationStrategy: PID 18036 died... 19:17:06.119566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18036): Terminated: ok {rc=0} 19:17:06.205691 bus /gobi_0: Setting Powered False 19:17:07.306410 bus /gobi_0: Setting Powered False 19:17:08.420238 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:17:09.570460 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:09.582617 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:17:09.644231 tst iperf3.py: using LAC 30929 19:17:09.773370 tst iperf3.py: using RAC 74 19:17:09.901186 tst iperf3.py: using CellId 30929 19:17:10.021674 tst iperf3.py: using BVCI 30930 19:17:10.131715 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.142705 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.153620 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.164396 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.175051 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.185791 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.196622 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.207370 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:10.218233 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:17:10.337605 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:17:10.560645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:10.891420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18038): Launched 19:17:11.178590 run iperf3-srv_10.42.42.10(pid=18039): Launched 19:17:11.302129 tst iperf3.py:8: start network... 19:17:11.524076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:12.033069 run create_hlr_db(pid=18040): Launched 19:17:12.158748 bus /gobi_6: Setting Powered False 19:17:13.223212 run create_hlr_db(pid=18040): Terminated: ok {rc=0} 19:17:13.679786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18042): Launched 19:17:14.007715 run osmo-hlr_10.42.42.2(pid=18043): Launched 19:17:14.132718 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:14.702132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18045): Launched 19:17:15.029989 run osmo-stp_10.42.42.5(pid=18046): Launched 19:17:15.154761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:15.720139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18048): Launched 19:17:15.846580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:16.138494 run patchelf(pid=18049): Launched 19:17:16.335391 run osmo-stp_10.42.42.5(pid=18046): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18046)] 19:17:16.478116 run osmo-stp_10.42.42.5(pid=18046): stdout: | (launched: 2022-12-12_19:17:14.969767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:16.622578 run osmo-stp_10.42.42.5(pid=18046): stderr: | 20221212191715161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191715161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191715161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191715161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191715162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191715162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191715162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:16.767592 run osmo-stp_10.42.42.5(pid=18046): stdout: | (launched: 2022-12-12_19:17:14.969767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:16.905966 run osmo-stp_10.42.42.5(pid=18046): stderr: | 20221212191715161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191715161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191715161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191715161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191715162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191715162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191715162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:17.069108 run patchelf(pid=18049): Terminating (SIGINT) 19:17:17.253884 run patchelf(pid=18049): Terminated: ok {rc=0} 19:17:17.378435 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18046): Process ended prematurely: osmo-stp_10.42.42.5(pid=18046) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18046)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 19:17:17.387796 tst iperf3.py:8: Test FAILED (7.9 sec) 19:17:17.415599 run osmo-hlr_10.42.42.2(pid=18043): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18043)] 19:17:17.464141 run osmo-hlr_10.42.42.2(pid=18043): stdout: | (launched: 2022-12-12_19:17:13.947761) 19:17:17.514587 run osmo-hlr_10.42.42.2(pid=18043): stderr: | 20221212191714163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191714163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191714163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191714163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191714163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191714163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191714176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191714184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191714185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191714185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:17.565344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18038): Terminating (SIGTERM) 19:17:17.606005 run iperf3-srv_10.42.42.10(pid=18039): Terminating (SIGTERM) 19:17:17.646632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18042): Terminating (SIGTERM) 19:17:17.687301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18045): Terminating (SIGTERM) 19:17:17.727761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18048): Terminating (SIGTERM) 19:17:17.769181 --- ParallelTerminationStrategy: PID 18038 died... 19:17:17.788659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18038): Terminated: ok {rc=0} 19:17:17.833366 --- ParallelTerminationStrategy: PID 18039 died... 19:17:17.852181 run iperf3-srv_10.42.42.10(pid=18039): Terminated {rc=256} 19:17:17.897280 --- ParallelTerminationStrategy: PID 18042 died... 19:17:17.916191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18042): Terminated: ok {rc=0} 19:17:17.960639 --- ParallelTerminationStrategy: PID 18045 died... 19:17:17.979537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18045): Terminated: ok {rc=0} 19:17:18.024156 --- ParallelTerminationStrategy: PID 18048 died... 19:17:18.043024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18048): Terminated: ok {rc=0} 19:17:18.128496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:17:19.279571 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.291647 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:17:19.350487 tst iperf3m4.py: using LAC 30930 19:17:19.479720 tst iperf3m4.py: using RAC 75 19:17:19.607204 tst iperf3m4.py: using CellId 30930 19:17:19.736525 tst iperf3m4.py: using BVCI 30931 19:17:19.855436 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.866883 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.878171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.889697 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.901072 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.912587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.924386 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.935860 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:19.947570 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:17:20.069047 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:17:20.189118 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:17:20.309251 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:17:20.426658 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:17:20.632795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:20.941488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18050): Launched 19:17:21.207809 run iperf3-srv_10.42.42.10(pid=18051): Launched 19:17:21.322482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:17:21.526717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:21.834112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18052): Launched 19:17:22.101535 run iperf3-srv_10.42.42.10(pid=18053): Launched 19:17:22.215859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:17:22.420160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:22.726731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18054): Launched 19:17:22.993685 run iperf3-srv_10.42.42.10(pid=18055): Launched 19:17:23.107495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:17:23.311093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:23.618613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18056): Launched 19:17:23.885720 run iperf3-srv_10.42.42.10(pid=18057): Launched 19:17:23.999988 tst iperf3m4.py:8: start network... 19:17:24.203414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:24.675515 run create_hlr_db(pid=18058): Launched 19:17:24.801208 bus /gobi_6: Setting Powered False 19:17:25.865532 run create_hlr_db(pid=18058): Terminated: ok {rc=0} 19:17:26.322692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18060): Launched 19:17:26.650734 run osmo-hlr_10.42.42.2(pid=18061): Launched 19:17:26.774938 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:27.338768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18063): Launched 19:17:27.649783 run osmo-stp_10.42.42.5(pid=18064): Launched 19:17:27.766794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:28.292869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18066): Launched 19:17:28.409714 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:28.668000 run patchelf(pid=18067): Launched 19:17:28.837626 run osmo-stp_10.42.42.5(pid=18064): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18064)] 19:17:28.966855 run osmo-stp_10.42.42.5(pid=18064): stdout: | (launched: 2022-12-12_19:17:27.592882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:29.097621 run osmo-stp_10.42.42.5(pid=18064): stderr: | 20221212191727761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191727761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191727761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191727762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191727762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191727762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191727762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:29.228499 run osmo-stp_10.42.42.5(pid=18064): stdout: | (launched: 2022-12-12_19:17:27.592882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:29.352842 run osmo-stp_10.42.42.5(pid=18064): stderr: | 20221212191727761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191727761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191727761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191727762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191727762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191727762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191727762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:29.501688 run patchelf(pid=18067): Terminating (SIGINT) 19:17:29.672581 run patchelf(pid=18067): Terminated: ok {rc=0} 19:17:29.795916 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18064): Process ended prematurely: osmo-stp_10.42.42.5(pid=18064) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18064)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:17:29.805415 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:17:29.833147 run osmo-hlr_10.42.42.2(pid=18061): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18061)] 19:17:29.881401 run osmo-hlr_10.42.42.2(pid=18061): stdout: | (launched: 2022-12-12_19:17:26.590558) 19:17:29.931716 run osmo-hlr_10.42.42.2(pid=18061): stderr: | 20221212191726787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191726787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191726787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191726787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191726787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191726787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191726800 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191726808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191726808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191726809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:29.982109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18050): Terminating (SIGTERM) 19:17:30.022288 run iperf3-srv_10.42.42.10(pid=18051): Terminating (SIGTERM) 19:17:30.062317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18052): Terminating (SIGTERM) 19:17:30.102601 run iperf3-srv_10.42.42.10(pid=18053): Terminating (SIGTERM) 19:17:30.142729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18054): Terminating (SIGTERM) 19:17:30.182689 run iperf3-srv_10.42.42.10(pid=18055): Terminating (SIGTERM) 19:17:30.222561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18056): Terminating (SIGTERM) 19:17:30.262377 run iperf3-srv_10.42.42.10(pid=18057): Terminating (SIGTERM) 19:17:30.302111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18060): Terminating (SIGTERM) 19:17:30.341986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18063): Terminating (SIGTERM) 19:17:30.381876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18066): Terminating (SIGTERM) 19:17:30.422012 --- ParallelTerminationStrategy: PID 18050 died... 19:17:30.441420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18050): Terminated: ok {rc=0} 19:17:30.486437 --- ParallelTerminationStrategy: PID 18051 died... 19:17:30.505198 run iperf3-srv_10.42.42.10(pid=18051): Terminated {rc=256} 19:17:30.549496 --- ParallelTerminationStrategy: PID 18052 died... 19:17:30.568417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18052): Terminated: ok {rc=0} 19:17:30.612728 --- ParallelTerminationStrategy: PID 18053 died... 19:17:30.631533 run iperf3-srv_10.42.42.10(pid=18053): Terminated {rc=256} 19:17:30.675766 --- ParallelTerminationStrategy: PID 18054 died... 19:17:30.694587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18054): Terminated: ok {rc=0} 19:17:30.738843 --- ParallelTerminationStrategy: PID 18055 died... 19:17:30.757654 run iperf3-srv_10.42.42.10(pid=18055): Terminated {rc=256} 19:17:30.801832 --- ParallelTerminationStrategy: PID 18056 died... 19:17:30.820612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18056): Terminated: ok {rc=0} 19:17:30.889189 --- ParallelTerminationStrategy: PID 18057 died... 19:17:30.914453 run iperf3-srv_10.42.42.10(pid=18057): Terminated {rc=256} 19:17:30.964848 --- ParallelTerminationStrategy: PID 18060 died... 19:17:30.986212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18060): Terminated: ok {rc=0} 19:17:31.038019 --- ParallelTerminationStrategy: PID 18063 died... 19:17:31.059106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18063): Terminated: ok {rc=0} 19:17:31.110831 --- ParallelTerminationStrategy: PID 18066 died... 19:17:31.131926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18066): Terminated: ok {rc=0} 19:17:31.228730 bus /gobi_4: Setting Powered False 19:17:32.330617 bus /gobi_4: Setting Powered False 19:17:33.447530 bus /gobi_1: Setting Powered False 19:17:34.547803 bus /gobi_1: Setting Powered False 19:17:35.665389 bus /gobi_0: Setting Powered False 19:17:36.766139 bus /gobi_0: Setting Powered False 19:17:37.883294 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:17:38.987788 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:38.999322 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:17:39.057835 tst ping.py: using LAC 30931 19:17:39.177799 tst ping.py: using RAC 76 19:17:39.297395 tst ping.py: using CellId 30931 19:17:39.414447 tst ping.py: using BVCI 30932 19:17:39.525123 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:39.535994 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:39.546755 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:39.557573 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:39.568157 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:39.578776 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:39.590199 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:39.600800 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:17:39.717773 tst ping.py:19: start network... 19:17:39.919238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:40.385696 run create_hlr_db(pid=18068): Launched 19:17:40.507724 bus /gobi_6: Setting Powered False 19:17:41.568465 run create_hlr_db(pid=18068): Terminated: ok {rc=0} 19:17:41.989646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18070): Launched 19:17:42.289682 run osmo-hlr_10.42.42.2(pid=18071): Launched 19:17:42.403356 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:42.927486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18073): Launched 19:17:43.226785 run osmo-stp_10.42.42.5(pid=18074): Launched 19:17:43.339498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:43.856077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18076): Launched 19:17:43.970641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:44.224195 run patchelf(pid=18077): Launched 19:17:44.390531 run osmo-stp_10.42.42.5(pid=18074): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18074)] 19:17:44.516702 run osmo-stp_10.42.42.5(pid=18074): stdout: | (launched: 2022-12-12_19:17:43.171057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:44.645192 run osmo-stp_10.42.42.5(pid=18074): stderr: | 20221212191743338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191743338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191743338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191743338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191743339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191743339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191743339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:44.773476 run osmo-stp_10.42.42.5(pid=18074): stdout: | (launched: 2022-12-12_19:17:43.171057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:44.895747 run osmo-stp_10.42.42.5(pid=18074): stderr: | 20221212191743338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191743338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191743338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191743338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191743339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191743339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191743339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:45.040428 run patchelf(pid=18077): Terminating (SIGINT) 19:17:45.207396 run patchelf(pid=18077): Terminated: ok {rc=0} 19:17:45.327875 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18074): Process ended prematurely: osmo-stp_10.42.42.5(pid=18074) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18074)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 19:17:45.336673 tst ping.py:22: Test FAILED (6.3 sec) 19:17:45.363394 run osmo-hlr_10.42.42.2(pid=18071): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18071)] 19:17:45.411199 run osmo-hlr_10.42.42.2(pid=18071): stdout: | (launched: 2022-12-12_19:17:42.234091) 19:17:45.461292 run osmo-hlr_10.42.42.2(pid=18071): stderr: | 20221212191742409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191742409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191742409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191742409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191742409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191742409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191742422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191742430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191742431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191742431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:45.511225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18070): Terminating (SIGTERM) 19:17:45.551470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18073): Terminating (SIGTERM) 19:17:45.591127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18076): Terminating (SIGTERM) 19:17:45.631070 --- ParallelTerminationStrategy: PID 18070 died... 19:17:45.650259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18070): Terminated: ok {rc=0} 19:17:45.694241 --- ParallelTerminationStrategy: PID 18073 died... 19:17:45.713026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18073): Terminated: ok {rc=0} 19:17:45.756706 --- ParallelTerminationStrategy: PID 18076 died... 19:17:45.775387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18076): Terminated: ok {rc=0} 19:17:45.878693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:17:46.980423 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:46.994824 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:17:47.062642 tst ping_idle_ping.py: using LAC 30932 19:17:47.192752 tst ping_idle_ping.py: using RAC 77 19:17:47.322528 tst ping_idle_ping.py: using CellId 30932 19:17:47.449970 tst ping_idle_ping.py: using BVCI 30933 19:17:47.567623 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:47.579324 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:47.590710 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:47.602307 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:47.613823 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:47.625364 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:47.637099 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:17:47.648561 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:17:47.768027 tst ping_idle_ping.py:24: start network... 19:17:47.985304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:48.488560 run create_hlr_db(pid=18078): Launched 19:17:48.611497 bus /gobi_6: Setting Powered False 19:17:49.675201 run create_hlr_db(pid=18078): Terminated: ok {rc=0} 19:17:50.108415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18080): Launched 19:17:50.435199 run osmo-hlr_10.42.42.2(pid=18081): Launched 19:17:50.559047 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:51.118980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18083): Launched 19:17:51.443732 run osmo-stp_10.42.42.5(pid=18084): Launched 19:17:51.567106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:17:52.128581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18086): Launched 19:17:52.251727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:17:52.527238 run patchelf(pid=18087): Launched 19:17:52.709357 run osmo-stp_10.42.42.5(pid=18084): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18084)] 19:17:52.846126 run osmo-stp_10.42.42.5(pid=18084): stdout: | (launched: 2022-12-12_19:17:51.383886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:52.984341 run osmo-stp_10.42.42.5(pid=18084): stderr: | 20221212191751575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191751575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191751575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191751576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191751576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191751576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191751576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:53.123567 run osmo-stp_10.42.42.5(pid=18084): stdout: | (launched: 2022-12-12_19:17:51.383886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:53.256073 run osmo-stp_10.42.42.5(pid=18084): stderr: | 20221212191751575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191751575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191751575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191751576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191751576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191751576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191751576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:53.414189 run patchelf(pid=18087): Terminating (SIGINT) 19:17:53.594647 run patchelf(pid=18087): Terminated: ok {rc=0} 19:17:53.725179 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18084): Process ended prematurely: osmo-stp_10.42.42.5(pid=18084) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18084)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:17:53.734840 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:17:53.763669 run osmo-hlr_10.42.42.2(pid=18081): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18081)] 19:17:53.814698 run osmo-hlr_10.42.42.2(pid=18081): stdout: | (launched: 2022-12-12_19:17:50.375599) 19:17:53.868038 run osmo-hlr_10.42.42.2(pid=18081): stderr: | 20221212191750571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191750571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191750571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191750571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191750572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191750572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191750584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191750592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191750592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191750592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:53.921392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18080): Terminating (SIGTERM) 19:17:53.963712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18083): Terminating (SIGTERM) 19:17:54.006053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18086): Terminating (SIGTERM) 19:17:54.048676 --- ParallelTerminationStrategy: PID 18080 died... 19:17:54.068865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18080): Terminated: ok {rc=0} 19:17:54.115946 --- ParallelTerminationStrategy: PID 18083 died... 19:17:54.135507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18083): Terminated: ok {rc=0} 19:17:54.182709 --- ParallelTerminationStrategy: PID 18086 died... 19:17:54.202412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18086): Terminated: ok {rc=0} 19:17:54.290581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:17:55.576117 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:17:55.582075 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:17:55.602899 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:17:55.641250 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:17:55.727783 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:17:55.748403 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:17:55.786450 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:17:56.379315 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:17:56.428288 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:56.439447 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:17:56.497067 tst cs_paging_gprs_active.py: using LAC 30933 19:17:56.618207 tst cs_paging_gprs_active.py: using RAC 78 19:17:56.739521 tst cs_paging_gprs_active.py: using CellId 30933 19:17:56.860282 tst cs_paging_gprs_active.py: using BVCI 30934 19:17:56.972467 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:56.983363 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:56.994058 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:57.004705 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:57.015321 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:57.025993 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:57.036715 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:57.047238 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:17:57.058000 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:17:57.179937 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:17:57.297386 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:17:57.504002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:57.812859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18091): Launched 19:17:58.079679 run iperf3-srv_10.42.42.10(pid=18092): Launched 19:17:58.194137 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:17:58.397722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:17:58.704204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18093): Launched 19:17:58.971330 run iperf3-srv_10.42.42.10(pid=18094): Launched 19:17:59.085623 tst cs_paging_gprs_active.py:38: start network... 19:17:59.289474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:59.762699 run create_hlr_db(pid=18095): Launched 19:17:59.886998 bus /gobi_6: Setting Powered False 19:18:00.952894 run create_hlr_db(pid=18095): Terminated: ok {rc=0} 19:18:01.492292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18097): Launched 19:18:01.843148 run osmo-hlr_10.42.42.2(pid=18098): Launched 19:18:02.094686 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:02.692265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18100): Launched 19:18:02.997695 run osmo-stp_10.42.42.5(pid=18101): Launched 19:18:03.113309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:03.639588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18103): Launched 19:18:03.757664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:04.015908 run patchelf(pid=18104): Launched 19:18:04.186205 run osmo-stp_10.42.42.5(pid=18101): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18101)] 19:18:04.315768 run osmo-stp_10.42.42.5(pid=18101): stdout: | (launched: 2022-12-12_19:18:02.940712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:04.447020 run osmo-stp_10.42.42.5(pid=18101): stderr: | 20221212191803110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191803110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191803110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191803111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191803112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191803112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191803112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:04.577958 run osmo-stp_10.42.42.5(pid=18101): stdout: | (launched: 2022-12-12_19:18:02.940712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:04.702544 run osmo-stp_10.42.42.5(pid=18101): stderr: | 20221212191803110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191803110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191803110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191803111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191803112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191803112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191803112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:04.850662 run patchelf(pid=18104): Terminating (SIGINT) 19:18:05.022149 run patchelf(pid=18104): Terminated: ok {rc=0} 19:18:05.145755 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18101): Process ended prematurely: osmo-stp_10.42.42.5(pid=18101) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18101)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:18:05.155115 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:18:05.182461 run osmo-hlr_10.42.42.2(pid=18098): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18098)] 19:18:05.230679 run osmo-hlr_10.42.42.2(pid=18098): stdout: | (launched: 2022-12-12_19:18:01.778070) 19:18:05.280423 run osmo-hlr_10.42.42.2(pid=18098): stderr: | 20221212191802153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191802153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191802153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191802153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191802153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191802153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191802170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191802191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191802191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191802191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:05.330482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18091): Terminating (SIGTERM) 19:18:05.370400 run iperf3-srv_10.42.42.10(pid=18092): Terminating (SIGTERM) 19:18:05.410595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18093): Terminating (SIGTERM) 19:18:05.450729 run iperf3-srv_10.42.42.10(pid=18094): Terminating (SIGTERM) 19:18:05.490674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18097): Terminating (SIGTERM) 19:18:05.530673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18100): Terminating (SIGTERM) 19:18:05.570504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18103): Terminating (SIGTERM) 19:18:05.610579 --- ParallelTerminationStrategy: PID 18091 died... 19:18:05.629894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18091): Terminated: ok {rc=0} 19:18:05.674839 --- ParallelTerminationStrategy: PID 18092 died... 19:18:05.693743 run iperf3-srv_10.42.42.10(pid=18092): Terminated {rc=256} 19:18:05.737791 --- ParallelTerminationStrategy: PID 18093 died... 19:18:05.756564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18093): Terminated: ok {rc=0} 19:18:05.800655 --- ParallelTerminationStrategy: PID 18094 died... 19:18:05.819610 run iperf3-srv_10.42.42.10(pid=18094): Terminated {rc=256} 19:18:05.863586 --- ParallelTerminationStrategy: PID 18097 died... 19:18:05.882773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18097): Terminated: ok {rc=0} 19:18:05.926915 --- ParallelTerminationStrategy: PID 18100 died... 19:18:05.945851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18100): Terminated: ok {rc=0} 19:18:05.989864 --- ParallelTerminationStrategy: PID 18103 died... 19:18:06.008714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18103): Terminated: ok {rc=0} 19:18:06.095809 bus /gobi_0: Setting Powered False 19:18:07.198226 bus /gobi_0: Setting Powered False 19:18:08.311052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:18:09.453722 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:09.465404 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:18:09.525442 tst iperf3.py: using LAC 30934 19:18:09.645142 tst iperf3.py: using RAC 79 19:18:09.765193 tst iperf3.py: using CellId 30934 19:18:09.887024 tst iperf3.py: using BVCI 30935 19:18:09.998724 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.009981 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.020824 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.031526 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.042456 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.053352 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.064252 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.074885 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:10.085733 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:18:10.202394 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:18:10.407870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:10.715338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18105): Launched 19:18:10.983838 run iperf3-srv_10.42.42.10(pid=18106): Launched 19:18:11.099029 tst iperf3.py:8: start network... 19:18:11.303946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:11.779165 run create_hlr_db(pid=18107): Launched 19:18:11.903392 bus /gobi_6: Setting Powered False 19:18:12.964509 run create_hlr_db(pid=18107): Terminated: ok {rc=0} 19:18:13.392591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18109): Launched 19:18:13.699444 run osmo-hlr_10.42.42.2(pid=18110): Launched 19:18:13.816698 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:14.344088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18112): Launched 19:18:14.650103 run osmo-stp_10.42.42.5(pid=18113): Launched 19:18:14.766541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:15.294139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18115): Launched 19:18:15.411487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:15.670513 run patchelf(pid=18116): Launched 19:18:15.859119 run osmo-stp_10.42.42.5(pid=18113): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18113)] 19:18:16.007467 run osmo-stp_10.42.42.5(pid=18113): stdout: | (launched: 2022-12-12_19:18:14.593384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:16.153988 run osmo-stp_10.42.42.5(pid=18113): stderr: | 20221212191814761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191814761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191814761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191814762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191814762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191814762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191814762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:16.299930 run osmo-stp_10.42.42.5(pid=18113): stdout: | (launched: 2022-12-12_19:18:14.593384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:16.441639 run osmo-stp_10.42.42.5(pid=18113): stderr: | 20221212191814761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191814761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191814761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191814762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191814762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191814762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191814762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:16.607339 run patchelf(pid=18116): Terminating (SIGINT) 19:18:16.798036 run patchelf(pid=18116): Terminated: ok {rc=0} 19:18:16.935241 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18113): Process ended prematurely: osmo-stp_10.42.42.5(pid=18113) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18113)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 19:18:16.946783 tst iperf3.py:8: Test FAILED (7.5 sec) 19:18:16.979433 run osmo-hlr_10.42.42.2(pid=18110): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18110)] 19:18:17.034814 run osmo-hlr_10.42.42.2(pid=18110): stdout: | (launched: 2022-12-12_19:18:13.642891) 19:18:17.090141 run osmo-hlr_10.42.42.2(pid=18110): stderr: | 20221212191813816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191813816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191813816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191813816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191813816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191813816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191813828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191813837 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191813837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191813837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:17.148226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18105): Terminating (SIGTERM) 19:18:17.192595 run iperf3-srv_10.42.42.10(pid=18106): Terminating (SIGTERM) 19:18:17.236117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18109): Terminating (SIGTERM) 19:18:17.279794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18112): Terminating (SIGTERM) 19:18:17.323394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18115): Terminating (SIGTERM) 19:18:17.367355 --- ParallelTerminationStrategy: PID 18105 died... 19:18:17.388168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18105): Terminated: ok {rc=0} 19:18:17.437338 --- ParallelTerminationStrategy: PID 18106 died... 19:18:17.457451 run iperf3-srv_10.42.42.10(pid=18106): Terminated {rc=256} 19:18:17.506234 --- ParallelTerminationStrategy: PID 18109 died... 19:18:17.526352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18109): Terminated: ok {rc=0} 19:18:17.574192 --- ParallelTerminationStrategy: PID 18112 died... 19:18:17.594438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18112): Terminated: ok {rc=0} 19:18:17.642282 --- ParallelTerminationStrategy: PID 18115 died... 19:18:17.662537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18115): Terminated: ok {rc=0} 19:18:17.752385 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:18:18.904896 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:18.917318 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:18:18.976304 tst iperf3m4.py: using LAC 30935 19:18:19.103717 tst iperf3m4.py: using RAC 80 19:18:19.230994 tst iperf3m4.py: using CellId 30935 19:18:19.361734 tst iperf3m4.py: using BVCI 30936 19:18:19.475157 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.486518 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.497520 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.508641 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.519732 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.530878 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.541967 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.552725 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:19.563944 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:18:19.680088 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:18:19.801573 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:18:19.919525 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:18:20.040248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:18:20.261995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:20.592462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Launched 19:18:20.878226 run iperf3-srv_10.42.42.10(pid=18118): Launched 19:18:21.001205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:18:21.222265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:21.552116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119): Launched 19:18:21.837602 run iperf3-srv_10.42.42.10(pid=18120): Launched 19:18:21.959916 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:18:22.179033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:22.508275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18121): Launched 19:18:22.794068 run iperf3-srv_10.42.42.10(pid=18122): Launched 19:18:22.916402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:18:23.136653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:23.466710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18123): Launched 19:18:23.752077 run iperf3-srv_10.42.42.10(pid=18124): Launched 19:18:23.875279 tst iperf3m4.py:8: start network... 19:18:24.095030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:24.603539 run create_hlr_db(pid=18125): Launched 19:18:24.727838 bus /gobi_6: Setting Powered False 19:18:25.793326 run create_hlr_db(pid=18125): Terminated: ok {rc=0} 19:18:26.231682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18127): Launched 19:18:26.539177 run osmo-hlr_10.42.42.2(pid=18128): Launched 19:18:26.656770 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:27.206424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18130): Launched 19:18:27.512356 run osmo-stp_10.42.42.5(pid=18131): Launched 19:18:27.629211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:28.158553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18133): Launched 19:18:28.275802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:28.535314 run patchelf(pid=18134): Launched 19:18:28.705817 run osmo-stp_10.42.42.5(pid=18131): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18131)] 19:18:28.835742 run osmo-stp_10.42.42.5(pid=18131): stdout: | (launched: 2022-12-12_19:18:27.455498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:28.968594 run osmo-stp_10.42.42.5(pid=18131): stderr: | 20221212191827624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191827624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191827624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191827625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191827625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191827625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191827625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:29.100547 run osmo-stp_10.42.42.5(pid=18131): stdout: | (launched: 2022-12-12_19:18:27.455498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:29.225976 run osmo-stp_10.42.42.5(pid=18131): stderr: | 20221212191827624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191827624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191827624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191827625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191827625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191827625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191827625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:29.374672 run patchelf(pid=18134): Terminating (SIGINT) 19:18:29.546420 run patchelf(pid=18134): Terminated: ok {rc=0} 19:18:29.670322 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18131): Process ended prematurely: osmo-stp_10.42.42.5(pid=18131) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18131)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:18:29.679854 tst iperf3m4.py:8: Test FAILED (10.8 sec) 19:18:29.707818 run osmo-hlr_10.42.42.2(pid=18128): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18128)] 19:18:29.756014 run osmo-hlr_10.42.42.2(pid=18128): stdout: | (launched: 2022-12-12_19:18:26.482355) 19:18:29.806190 run osmo-hlr_10.42.42.2(pid=18128): stderr: | 20221212191826658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191826658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191826658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191826658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191826658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191826658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191826671 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191826679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191826679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191826679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:29.857069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Terminating (SIGTERM) 19:18:29.897988 run iperf3-srv_10.42.42.10(pid=18118): Terminating (SIGTERM) 19:18:29.938325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119): Terminating (SIGTERM) 19:18:29.978891 run iperf3-srv_10.42.42.10(pid=18120): Terminating (SIGTERM) 19:18:30.019154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18121): Terminating (SIGTERM) 19:18:30.059466 run iperf3-srv_10.42.42.10(pid=18122): Terminating (SIGTERM) 19:18:30.099777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18123): Terminating (SIGTERM) 19:18:30.140109 run iperf3-srv_10.42.42.10(pid=18124): Terminating (SIGTERM) 19:18:30.180296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18127): Terminating (SIGTERM) 19:18:30.220710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18130): Terminating (SIGTERM) 19:18:30.261063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18133): Terminating (SIGTERM) 19:18:30.301868 --- ParallelTerminationStrategy: PID 18117 died... 19:18:30.321357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18117): Terminated: ok {rc=0} 19:18:30.366143 --- ParallelTerminationStrategy: PID 18118 died... 19:18:30.384933 run iperf3-srv_10.42.42.10(pid=18118): Terminated {rc=256} 19:18:30.429633 --- ParallelTerminationStrategy: PID 18119 died... 19:18:30.448668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119): Terminated: ok {rc=0} 19:18:30.493279 --- ParallelTerminationStrategy: PID 18120 died... 19:18:30.512197 run iperf3-srv_10.42.42.10(pid=18120): Terminated {rc=256} 19:18:30.556673 --- ParallelTerminationStrategy: PID 18121 died... 19:18:30.575682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18121): Terminated: ok {rc=0} 19:18:30.620255 --- ParallelTerminationStrategy: PID 18122 died... 19:18:30.639226 run iperf3-srv_10.42.42.10(pid=18122): Terminated {rc=256} 19:18:30.683851 --- ParallelTerminationStrategy: PID 18123 died... 19:18:30.702915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18123): Terminated: ok {rc=0} 19:18:30.747954 --- ParallelTerminationStrategy: PID 18124 died... 19:18:30.766943 run iperf3-srv_10.42.42.10(pid=18124): Terminated {rc=256} 19:18:30.811531 --- ParallelTerminationStrategy: PID 18127 died... 19:18:30.835523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18127): Terminated: ok {rc=0} 19:18:30.881865 --- ParallelTerminationStrategy: PID 18130 died... 19:18:30.901464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18130): Terminated: ok {rc=0} 19:18:30.960253 --- ParallelTerminationStrategy: PID 18133 died... 19:18:30.987878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18133): Terminated: ok {rc=0} 19:18:31.077072 bus /gobi_4: Setting Powered False 19:18:32.190097 bus /gobi_4: Setting Powered False 19:18:33.310663 bus /gobi_1: Setting Powered False 19:18:34.410992 bus /gobi_1: Setting Powered False 19:18:35.528390 bus /gobi_0: Setting Powered False 19:18:36.627554 bus /gobi_0: Setting Powered False 19:18:37.744692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:18:38.850552 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:38.862721 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:18:38.922382 tst ping.py: using LAC 30936 19:18:39.048575 tst ping.py: using RAC 81 19:18:39.179540 tst ping.py: using CellId 30936 19:18:39.298698 tst ping.py: using BVCI 30937 19:18:39.407746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:39.418943 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:39.429924 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:39.441572 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:39.452883 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:39.464299 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:39.475918 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:39.487233 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:18:39.602066 tst ping.py:19: start network... 19:18:39.803190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:40.268749 run create_hlr_db(pid=18135): Launched 19:18:40.391152 bus /gobi_6: Setting Powered False 19:18:41.451502 run create_hlr_db(pid=18135): Terminated: ok {rc=0} 19:18:41.870729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18137): Launched 19:18:42.171077 run osmo-hlr_10.42.42.2(pid=18138): Launched 19:18:42.284139 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:42.806764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18140): Launched 19:18:43.106423 run osmo-stp_10.42.42.5(pid=18141): Launched 19:18:43.219975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:43.736449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18143): Launched 19:18:43.851476 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:44.106577 run patchelf(pid=18144): Launched 19:18:44.273922 run osmo-stp_10.42.42.5(pid=18141): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18141)] 19:18:44.401107 run osmo-stp_10.42.42.5(pid=18141): stdout: | (launched: 2022-12-12_19:18:43.050698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:44.530205 run osmo-stp_10.42.42.5(pid=18141): stderr: | 20221212191843217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191843217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191843217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191843218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191843218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191843218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191843219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:44.659010 run osmo-stp_10.42.42.5(pid=18141): stdout: | (launched: 2022-12-12_19:18:43.050698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:44.783093 run osmo-stp_10.42.42.5(pid=18141): stderr: | 20221212191843217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191843217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191843217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191843218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191843218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191843218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191843219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:44.928803 run patchelf(pid=18144): Terminating (SIGINT) 19:18:45.097121 run patchelf(pid=18144): Terminated: ok {rc=0} 19:18:45.218170 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18141): Process ended prematurely: osmo-stp_10.42.42.5(pid=18141) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18141)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 19:18:45.227091 tst ping.py:22: Test FAILED (6.4 sec) 19:18:45.254384 run osmo-hlr_10.42.42.2(pid=18138): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18138)] 19:18:45.303177 run osmo-hlr_10.42.42.2(pid=18138): stdout: | (launched: 2022-12-12_19:18:42.115125) 19:18:45.353725 run osmo-hlr_10.42.42.2(pid=18138): stderr: | 20221212191842287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191842287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191842287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191842287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191842288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191842288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191842299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191842308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191842309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191842309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:45.404442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18137): Terminating (SIGTERM) 19:18:45.445111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18140): Terminating (SIGTERM) 19:18:45.485794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18143): Terminating (SIGTERM) 19:18:45.526421 --- ParallelTerminationStrategy: PID 18137 died... 19:18:45.545909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18137): Terminated: ok {rc=0} 19:18:45.590600 --- ParallelTerminationStrategy: PID 18140 died... 19:18:45.609568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18140): Terminated: ok {rc=0} 19:18:45.654117 --- ParallelTerminationStrategy: PID 18143 died... 19:18:45.673019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18143): Terminated: ok {rc=0} 19:18:45.759928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:18:46.848721 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:46.861662 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:18:46.925656 tst ping_idle_ping.py: using LAC 30937 19:18:47.096414 tst ping_idle_ping.py: using RAC 82 19:18:47.224791 tst ping_idle_ping.py: using CellId 30937 19:18:47.353960 tst ping_idle_ping.py: using BVCI 30938 19:18:47.474284 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:47.486077 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:47.497565 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:47.509894 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:47.521958 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:47.534405 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:47.546855 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:18:47.559051 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:18:47.679320 tst ping_idle_ping.py:24: start network... 19:18:47.897920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:48.403911 run create_hlr_db(pid=18145): Launched 19:18:48.528836 bus /gobi_6: Setting Powered False 19:18:49.593557 run create_hlr_db(pid=18145): Terminated: ok {rc=0} 19:18:50.045949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18147): Launched 19:18:50.370061 run osmo-hlr_10.42.42.2(pid=18148): Launched 19:18:50.493997 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:51.057215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18150): Launched 19:18:51.380013 run osmo-stp_10.42.42.5(pid=18151): Launched 19:18:51.503909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:52.063296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18153): Launched 19:18:52.187810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:52.462275 run patchelf(pid=18154): Launched 19:18:52.642010 run osmo-stp_10.42.42.5(pid=18151): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18151)] 19:18:52.779182 run osmo-stp_10.42.42.5(pid=18151): stdout: | (launched: 2022-12-12_19:18:51.320295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:52.918339 run osmo-stp_10.42.42.5(pid=18151): stderr: | 20221212191851509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191851509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191851509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191851510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191851510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191851510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191851510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:53.057306 run osmo-stp_10.42.42.5(pid=18151): stdout: | (launched: 2022-12-12_19:18:51.320295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:53.189982 run osmo-stp_10.42.42.5(pid=18151): stderr: | 20221212191851509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191851509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191851509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191851510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191851510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191851510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191851510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:53.347756 run patchelf(pid=18154): Terminating (SIGINT) 19:18:53.528830 run patchelf(pid=18154): Terminated: ok {rc=0} 19:18:53.659393 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18151): Process ended prematurely: osmo-stp_10.42.42.5(pid=18151) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18151)] [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:18:53.669088 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:18:53.697911 run osmo-hlr_10.42.42.2(pid=18148): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18148)] 19:18:53.748674 run osmo-hlr_10.42.42.2(pid=18148): stdout: | (launched: 2022-12-12_19:18:50.310125) 19:18:53.801252 run osmo-hlr_10.42.42.2(pid=18148): stderr: | 20221212191850505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191850505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191850505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191850505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191850506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191850506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191850520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191850529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191850529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191850529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:53.854443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18147): Terminating (SIGTERM) 19:18:53.896672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18150): Terminating (SIGTERM) 19:18:53.939160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18153): Terminating (SIGTERM) 19:18:53.981826 --- ParallelTerminationStrategy: PID 18147 died... 19:18:54.002104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18147): Terminated: ok {rc=0} 19:18:54.048919 --- ParallelTerminationStrategy: PID 18150 died... 19:18:54.068604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18150): Terminated: ok {rc=0} 19:18:54.115665 --- ParallelTerminationStrategy: PID 18153 died... 19:18:54.135380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18153): Terminated: ok {rc=0} 19:18:54.223339 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:18:55.514754 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:18:55.521976 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:18:55.543704 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:18:55.579707 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:18:55.638244 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:18:55.660105 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:18:55.695966 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:18:56.246838 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:18:56.252864 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.264570 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:18:56.321362 tst switch_tch_pdch.py: using LAC 30938 19:18:56.440140 tst switch_tch_pdch.py: using RAC 83 19:18:56.556115 tst switch_tch_pdch.py: using CellId 30938 19:18:56.684801 tst switch_tch_pdch.py: using BVCI 30939 19:18:56.801920 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.813912 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.825729 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.837691 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.849426 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.861112 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.873050 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:18:56.884850 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:18:57.002865 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:18:57.122334 tst switch_tch_pdch.py:51: start network... 19:18:57.339659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:57.838769 run create_hlr_db(pid=18158): Launched 19:18:57.961580 bus /gobi_6: Setting Powered False 19:18:59.026751 run create_hlr_db(pid=18158): Terminated: ok {rc=0} 19:18:59.476792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18160): Launched 19:18:59.798727 run osmo-hlr_10.42.42.2(pid=18161): Launched 19:18:59.921732 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:00.477103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18163): Launched 19:19:00.798995 run osmo-stp_10.42.42.5(pid=18164): Launched 19:19:00.979620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:01.626908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18166): Launched 19:19:01.784269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:02.132318 run patchelf(pid=18167): Launched 19:19:02.363906 run osmo-stp_10.42.42.5(pid=18164): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18164)] 19:19:02.515656 run osmo-stp_10.42.42.5(pid=18164): stdout: | (launched: 2022-12-12_19:19:00.739745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:02.646576 run osmo-stp_10.42.42.5(pid=18164): stderr: | 20221212191901064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191901064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191901064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191901070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191901071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191901071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191901071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:02.775580 run osmo-stp_10.42.42.5(pid=18164): stdout: | (launched: 2022-12-12_19:19:00.739745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:02.898445 run osmo-stp_10.42.42.5(pid=18164): stderr: | 20221212191901064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191901064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191901064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191901070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191901071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191901071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191901071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:03.043669 run patchelf(pid=18167): Terminating (SIGINT) 19:19:03.211943 run patchelf(pid=18167): Terminated: ok {rc=0} 19:19:03.332718 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18164): Process ended prematurely: osmo-stp_10.42.42.5(pid=18164) [trial-2381↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18164)] [trial-2381↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:19:03.341676 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 19:19:03.368930 run osmo-hlr_10.42.42.2(pid=18161): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18161)] 19:19:03.417596 run osmo-hlr_10.42.42.2(pid=18161): stdout: | (launched: 2022-12-12_19:18:59.739359) 19:19:03.467832 run osmo-hlr_10.42.42.2(pid=18161): stderr: | 20221212191859934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191859934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191859934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191859934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191859934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191859934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191859946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191859955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191859955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191859955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:03.518452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18160): Terminating (SIGTERM) 19:19:03.558922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18163): Terminating (SIGTERM) 19:19:03.599445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18166): Terminating (SIGTERM) 19:19:03.639881 --- ParallelTerminationStrategy: PID 18160 died... 19:19:03.659430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18160): Terminated: ok {rc=0} 19:19:03.704129 --- ParallelTerminationStrategy: PID 18163 died... 19:19:03.722970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18163): Terminated: ok {rc=0} 19:19:03.767815 --- ParallelTerminationStrategy: PID 18166 died... 19:19:03.786572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18166): Terminated: ok {rc=0} 19:19:03.873295 bus /gobi_0: Setting Powered False 19:19:04.975409 bus /gobi_0: Setting Powered False 19:19:06.092471 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:19:07.333512 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:07.339257 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:19:07.359810 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:19:07.394845 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:19:07.447558 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:19:07.469252 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:19:07.505722 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:19:08.061539 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:19:08.067061 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.078788 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:19:08.136242 tst switch_tch_pdch.py: using LAC 30939 19:19:08.263450 tst switch_tch_pdch.py: using RAC 84 19:19:08.388153 tst switch_tch_pdch.py: using CellId 30939 19:19:08.516682 tst switch_tch_pdch.py: using BVCI 30940 19:19:08.626546 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.637516 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.648294 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.659055 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.669715 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.680254 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.691089 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:19:08.702149 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:19:08.823086 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:19:08.946036 tst switch_tch_pdch.py:51: start network... 19:19:09.165658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:09.639531 run create_hlr_db(pid=18171): Launched 19:19:09.764351 bus /gobi_6: Setting Powered False 19:19:10.828852 run create_hlr_db(pid=18171): Terminated: ok {rc=0} 19:19:11.252042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18173): Launched 19:19:11.575835 run osmo-hlr_10.42.42.2(pid=18174): Launched 19:19:11.699126 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:12.230906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18176): Launched 19:19:12.532209 run osmo-stp_10.42.42.5(pid=18177): Launched 19:19:12.646289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:13.138175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18179): Launched 19:19:13.253386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:13.507960 run patchelf(pid=18180): Launched 19:19:13.675455 run osmo-stp_10.42.42.5(pid=18177): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18177)] 19:19:13.803300 run osmo-stp_10.42.42.5(pid=18177): stdout: | (launched: 2022-12-12_19:19:12.476448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:13.932546 run osmo-stp_10.42.42.5(pid=18177): stderr: | 20221212191912644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191912644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191912644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191912645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191912645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191912646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191912646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:14.061962 run osmo-stp_10.42.42.5(pid=18177): stdout: | (launched: 2022-12-12_19:19:12.476448) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:14.185278 run osmo-stp_10.42.42.5(pid=18177): stderr: | 20221212191912644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191912644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191912644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191912645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191912645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191912646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191912646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:14.344228 run patchelf(pid=18180): Terminating (SIGINT) 19:19:14.525460 run patchelf(pid=18180): Terminated: ok {rc=0} 19:19:14.655474 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18177): Process ended prematurely: osmo-stp_10.42.42.5(pid=18177) [trial-2381↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18177)] [trial-2381↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:19:14.665407 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 19:19:14.694493 run osmo-hlr_10.42.42.2(pid=18174): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18174)] 19:19:14.745992 run osmo-hlr_10.42.42.2(pid=18174): stdout: | (launched: 2022-12-12_19:19:11.516260) 19:19:14.799456 run osmo-hlr_10.42.42.2(pid=18174): stderr: | 20221212191911711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191911711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191911711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191911711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191911711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191911711 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191911724 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191911732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191911732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191911732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:14.853251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18173): Terminating (SIGTERM) 19:19:14.896263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18176): Terminating (SIGTERM) 19:19:14.939271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18179): Terminating (SIGTERM) 19:19:14.982650 --- ParallelTerminationStrategy: PID 18173 died... 19:19:15.003252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18173): Terminated: ok {rc=0} 19:19:15.051245 --- ParallelTerminationStrategy: PID 18176 died... 19:19:15.071226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18176): Terminated: ok {rc=0} 19:19:15.118780 --- ParallelTerminationStrategy: PID 18179 died... 19:19:15.138854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18179): Terminated: ok {rc=0} 19:19:15.229044 bus /gobi_0: Setting Powered False 19:19:16.332282 bus /gobi_0: Setting Powered False 19:19:17.451173 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_sms:oc2g --------------------------------------------------------------------- 19:19:18.692214 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:18.696698 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 19:19:18.718041 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 19:19:18.725784 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 19:19:18.779777 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 19:19:18.801832 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 19:19:18.809187 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 19:19:19.346168 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 19:19:19.351270 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 19:19:19.362352 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 19:19:19.398312 tst mo_mt_sms.py: using LAC 30940 19:19:19.517084 tst mo_mt_sms.py: using RAC 85 19:19:19.644123 tst mo_mt_sms.py: using CellId 30940 19:19:19.770136 tst mo_mt_sms.py: using BVCI 30941 19:19:19.888917 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 19:19:20.005202 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 19:19:20.124762 tst mo_mt_sms.py:9: start nitb and bts... 19:19:20.343325 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:19:21.002316 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18184): Launched 19:19:21.327301 run osmo-nitb_10.42.42.2(pid=18185): Launched 19:19:21.506201 run osmo-nitb_10.42.42.2(pid=18185): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18185)] 19:19:21.651265 run osmo-nitb_10.42.42.2(pid=18185): stdout: | (launched: 2022-12-12_19:19:21.267844) 19:19:21.797525 run osmo-nitb_10.42.42.2(pid=18185): stderr: | (launched: 2022-12-12_19:19:21.315681) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:19:21.943717 run osmo-nitb_10.42.42.2(pid=18185): stdout: | (launched: 2022-12-12_19:19:21.267844) 19:19:22.084162 run osmo-nitb_10.42.42.2(pid=18185): stderr: | (launched: 2022-12-12_19:19:21.315681) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18185): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18185) [trial-2381↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18185)] 19:19:22.448826 tst osmo-nitb_10.42.42.2(pid=18185): stdout: | (launched: 2022-12-12_19:19:21.267844) 19:19:22.579717 tst osmo-nitb_10.42.42.2(pid=18185): stderr: | (launched: 2022-12-12_19:19:21.315681) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:19:22.733826 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18185): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18185) [trial-2381↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18185)] [trial-2381↪nitb_sms:oc2g↪mo_mt_sms.py:11] 19:19:22.742992 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 19:19:22.749996 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18184): Terminating (SIGTERM) 19:19:22.961621 --- ParallelTerminationStrategy: PID 18184 died... 19:19:22.983631 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18184): Terminated: ok {rc=0} 19:19:23.073001 bus /sierra_3: Setting Powered False 19:19:24.174287 bus /sierra_3: Setting Powered False 19:19:25.293536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:oc2g --------------------------------------------------------------------- 19:19:26.475410 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:26.479839 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 19:19:26.500340 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 19:19:26.527067 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 19:19:26.578514 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 19:19:26.599349 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 19:19:26.625891 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 19:19:27.170897 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:oc2g mo_mt_sms.py ---------------------------------------------- 19:19:27.175981 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 19:19:27.186685 tst sms:oc2g: Using 1 x bts (candidates: 1) 19:19:27.220517 tst mo_mt_sms.py: using LAC 30941 19:19:27.347905 tst mo_mt_sms.py: using RAC 86 19:19:27.474118 tst mo_mt_sms.py: using CellId 30941 19:19:27.601397 tst mo_mt_sms.py: using BVCI 30942 19:19:27.717856 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 19:19:27.728808 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 19:19:27.739830 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 19:19:27.751018 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 19:19:27.762244 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 19:19:27.773410 tst sms:oc2g: Using 1 x modem (candidates: 2) 19:19:27.888694 tst sms:oc2g: Using 1 x modem (candidates: 2) 19:19:28.009528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:28.475847 run create_hlr_db(pid=18189): Launched 19:19:28.599072 bus /sierra_2: Setting Powered False 19:19:29.658010 run create_hlr_db(pid=18189): Terminated: ok {rc=0} 19:19:30.099181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18191): Launched 19:19:30.405555 run osmo-hlr_10.42.42.2(pid=18192): Launched 19:19:30.518927 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:31.041195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18194): Launched 19:19:31.420509 run osmo-stp_10.42.42.5(pid=18195): Launched 19:19:31.731293 run osmo-msc_10.42.42.6: Starting osmo-msc 19:19:32.333773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18197): Launched 19:19:32.663244 run osmo-msc_10.42.42.6(pid=18198): Launched 19:19:32.843336 run osmo-stp_10.42.42.5(pid=18195): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18195)] 19:19:32.979009 run osmo-stp_10.42.42.5(pid=18195): stdout: | (launched: 2022-12-12_19:19:31.360302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:33.115309 run osmo-stp_10.42.42.5(pid=18195): stderr: | 20221212191931562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191931562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191931562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191931563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191931563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191931563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191931563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:33.250353 run osmo-stp_10.42.42.5(pid=18195): stdout: | (launched: 2022-12-12_19:19:31.360302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:33.378807 run osmo-stp_10.42.42.5(pid=18195): stderr: | 20221212191931562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191931562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191931562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191931563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191931563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191931563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191931563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:33.532784 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18195): Process ended prematurely: osmo-stp_10.42.42.5(pid=18195) [trial-2381↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18195)] [trial-2381↪sms:oc2g↪mo_mt_sms.py:16] 19:19:33.541893 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 19:19:33.569849 run osmo-hlr_10.42.42.2(pid=18192): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18192)] 19:19:33.620619 run osmo-hlr_10.42.42.2(pid=18192): stdout: | (launched: 2022-12-12_19:19:30.349338) 19:19:33.673195 run osmo-hlr_10.42.42.2(pid=18192): stderr: | 20221212191930522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191930523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191930523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191930523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191930523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191930523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191930535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191930546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191930546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191930546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:33.746175 run osmo-msc_10.42.42.6(pid=18198): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18198)] 19:19:33.797054 run osmo-msc_10.42.42.6(pid=18198): stdout: | (launched: 2022-12-12_19:19:32.602985) 19:19:33.849466 run osmo-msc_10.42.42.6(pid=18198): stderr: | 20221212191932921 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191932921 DLGLOBAL DEBUG validating counter group 0x7f027d7fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191932921 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191932921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191932922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191932922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191932923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191932924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191932924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191932924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:19:33.902251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18191): Terminating (SIGTERM) 19:19:33.944452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18194): Terminating (SIGTERM) 19:19:33.986868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18197): Terminating (SIGTERM) 19:19:34.029825 --- ParallelTerminationStrategy: PID 18191 died... 19:19:34.050102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18191): Terminated: ok {rc=0} 19:19:34.097724 --- ParallelTerminationStrategy: PID 18194 died... 19:19:34.117563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18194): Terminated: ok {rc=0} 19:19:34.164785 --- ParallelTerminationStrategy: PID 18197 died... 19:19:34.185029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18197): Terminated: ok {rc=0} 19:19:34.274671 bus /sierra_3: Setting Powered False 19:19:35.375808 bus /sierra_3: Setting Powered False 19:19:36.496211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:oc2g --------------------------------------------------------------------- 19:19:37.713486 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:37.717238 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 19:19:37.737628 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 19:19:37.744893 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 19:19:37.778899 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 19:19:37.799795 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 19:19:37.807244 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 19:19:38.326854 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 19:19:38.331996 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 19:19:38.342820 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 19:19:38.378390 tst assert_extension.py: using LAC 30942 19:19:38.506447 tst assert_extension.py: using RAC 87 19:19:38.633736 tst assert_extension.py: using CellId 30942 19:19:38.758919 tst assert_extension.py: using BVCI 30943 19:19:38.875432 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 19:19:38.990760 tst assert_extension.py:10: start nitb and bts... 19:19:39.192324 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:19:39.805141 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18203): Launched 19:19:40.105329 run osmo-nitb_10.42.42.2(pid=18204): Launched 19:19:40.271214 run osmo-nitb_10.42.42.2(pid=18204): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18204)] 19:19:40.406809 run osmo-nitb_10.42.42.2(pid=18204): stdout: | (launched: 2022-12-12_19:19:40.049098) 19:19:40.544508 run osmo-nitb_10.42.42.2(pid=18204): stderr: | (launched: 2022-12-12_19:19:40.093600) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:19:40.681499 run osmo-nitb_10.42.42.2(pid=18204): stdout: | (launched: 2022-12-12_19:19:40.049098) 19:19:40.812432 run osmo-nitb_10.42.42.2(pid=18204): stderr: | (launched: 2022-12-12_19:19:40.093600) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18204) [trial-2381↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18204)] 19:19:41.218278 tst osmo-nitb_10.42.42.2(pid=18204): stdout: | (launched: 2022-12-12_19:19:40.049098) 19:19:41.339644 tst osmo-nitb_10.42.42.2(pid=18204): stderr: | (launched: 2022-12-12_19:19:40.093600) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:19:41.482558 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18204) [trial-2381↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18204)] [trial-2381↪nitb_ussd:oc2g↪assert_extension.py:12] 19:19:41.490989 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:19:41.497828 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18203): Terminating (SIGTERM) 19:19:41.707490 --- ParallelTerminationStrategy: PID 18203 died... 19:19:41.728628 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18203): Terminated: ok {rc=0} 19:19:41.815543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:oc2g --------------------------------------------------------------------- 19:19:42.976820 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:42.980641 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 19:19:43.001108 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 19:19:43.028147 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 19:19:43.063917 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 19:19:43.084468 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 19:19:43.110918 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 19:19:43.638342 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:oc2g assert_extension.py ---------------------------------------------- 19:19:43.643549 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 19:19:43.654313 tst ussd:oc2g: Using 1 x bts (candidates: 1) 19:19:43.688250 tst assert_extension.py: using LAC 30943 19:19:43.805675 tst assert_extension.py: using RAC 88 19:19:43.922476 tst assert_extension.py: using CellId 30943 19:19:44.041089 tst assert_extension.py: using BVCI 30944 19:19:44.148390 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 19:19:44.158930 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 19:19:44.169695 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 19:19:44.180127 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 19:19:44.190690 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 19:19:44.201222 tst ussd:oc2g: Using 1 x modem (candidates: 1) 19:19:44.317860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:44.818568 run create_hlr_db(pid=18208): Launched 19:19:44.942165 bus /sierra_2: Setting Powered False 19:19:46.023510 run create_hlr_db(pid=18208): Terminated: ok {rc=0} 19:19:46.503057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18210): Launched 19:19:46.910761 run osmo-hlr_10.42.42.2(pid=18211): Launched 19:19:47.153564 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:47.764459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18213): Launched 19:19:48.088591 run osmo-stp_10.42.42.5(pid=18214): Launched 19:19:48.211385 run osmo-msc_10.42.42.6: Starting osmo-msc 19:19:48.795913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18216): Launched 19:19:49.119111 run osmo-msc_10.42.42.6(pid=18217): Launched 19:19:49.299356 run osmo-stp_10.42.42.5(pid=18214): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18214)] 19:19:49.436679 run osmo-stp_10.42.42.5(pid=18214): stdout: | (launched: 2022-12-12_19:19:48.028185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:49.573532 run osmo-stp_10.42.42.5(pid=18214): stderr: | 20221212191948219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191948219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191948219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191948219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191948220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191948220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191948220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:49.708676 run osmo-stp_10.42.42.5(pid=18214): stdout: | (launched: 2022-12-12_19:19:48.028185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:49.837366 run osmo-stp_10.42.42.5(pid=18214): stderr: | 20221212191948219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191948219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191948219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191948219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191948220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191948220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191948220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:49.991534 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18214): Process ended prematurely: osmo-stp_10.42.42.5(pid=18214) [trial-2381↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18214)] [trial-2381↪ussd:oc2g↪assert_extension.py:17] 19:19:50.000641 tst assert_extension.py:17: Test FAILED (6.3 sec) 19:19:50.028887 run osmo-hlr_10.42.42.2(pid=18211): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18211)] 19:19:50.079793 run osmo-hlr_10.42.42.2(pid=18211): stdout: | (launched: 2022-12-12_19:19:46.843457) 19:19:50.132202 run osmo-hlr_10.42.42.2(pid=18211): stderr: | 20221212191947097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191947097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191947097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191947097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191947097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191947097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191947114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191947131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191947135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191947136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:50.205089 run osmo-msc_10.42.42.6(pid=18217): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18217)] 19:19:50.256057 run osmo-msc_10.42.42.6(pid=18217): stdout: | (launched: 2022-12-12_19:19:49.059158) 19:19:50.308315 run osmo-msc_10.42.42.6(pid=18217): stderr: | 20221212191949379 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191949379 DLGLOBAL DEBUG validating counter group 0x7fafdb226c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191949379 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191949379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191949379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191949379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191949381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191949381 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191949382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191949382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:19:50.361367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18210): Terminating (SIGTERM) 19:19:50.403752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18213): Terminating (SIGTERM) 19:19:50.446367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18216): Terminating (SIGTERM) 19:19:50.489148 --- ParallelTerminationStrategy: PID 18210 died... 19:19:50.509577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18210): Terminated: ok {rc=0} 19:19:50.557101 --- ParallelTerminationStrategy: PID 18213 died... 19:19:50.577017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18213): Terminated: ok {rc=0} 19:19:50.624145 --- ParallelTerminationStrategy: PID 18216 died... 19:19:50.644099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18216): Terminated: ok {rc=0} 19:19:50.733785 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:19:51.933968 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:51.941511 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:19:51.963916 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:19:51.992845 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:19:52.047047 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:19:52.068861 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:19:52.097330 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:19:52.646107 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:19:52.700626 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:19:52.712381 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:19:52.774980 tst mo_mt_call.py: using LAC 30944 19:19:52.903710 tst mo_mt_call.py: using RAC 89 19:19:53.024870 tst mo_mt_call.py: using CellId 30944 19:19:53.142818 tst mo_mt_call.py: using BVCI 30945 19:19:53.254802 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:19:53.266182 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:19:53.277286 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:19:53.288043 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:19:53.299075 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:19:53.309955 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:19:53.423855 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:19:53.540370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:54.015675 run create_hlr_db(pid=18222): Launched 19:19:54.139674 bus /sierra_2: Setting Powered False 19:19:55.200398 run create_hlr_db(pid=18222): Terminated: ok {rc=0} 19:19:55.628252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18224): Launched 19:19:55.934935 run osmo-hlr_10.42.42.2(pid=18225): Launched 19:19:56.051468 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:56.594585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18227): Launched 19:19:56.901029 run osmo-stp_10.42.42.5(pid=18228): Launched 19:19:57.016639 run osmo-msc_10.42.42.6: Starting osmo-msc 19:19:57.569677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18230): Launched 19:19:57.874974 run osmo-msc_10.42.42.6(pid=18231): Launched 19:19:58.045545 run osmo-stp_10.42.42.5(pid=18228): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18228)] 19:19:58.174585 run osmo-stp_10.42.42.5(pid=18228): stdout: | (launched: 2022-12-12_19:19:56.843813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:58.302802 run osmo-stp_10.42.42.5(pid=18228): stderr: | 20221212191957015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191957015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191957015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191957016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191957016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191957016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191957016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:58.429409 run osmo-stp_10.42.42.5(pid=18228): stdout: | (launched: 2022-12-12_19:19:56.843813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:58.550361 run osmo-stp_10.42.42.5(pid=18228): stderr: | 20221212191957015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212191957015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212191957015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212191957016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212191957016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212191957016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212191957016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:58.696286 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18228): Process ended prematurely: osmo-stp_10.42.42.5(pid=18228) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18228)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:19:58.705183 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:19:58.731736 run osmo-hlr_10.42.42.2(pid=18225): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18225)] 19:19:58.779535 run osmo-hlr_10.42.42.2(pid=18225): stdout: | (launched: 2022-12-12_19:19:55.877626) 19:19:58.829173 run osmo-hlr_10.42.42.2(pid=18225): stderr: | 20221212191956054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212191956054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212191956054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212191956054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212191956054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212191956054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212191956067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212191956076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212191956077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212191956077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:58.898314 run osmo-msc_10.42.42.6(pid=18231): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18231)] 19:19:58.946147 run osmo-msc_10.42.42.6(pid=18231): stdout: | (launched: 2022-12-12_19:19:57.818105) 19:19:58.995434 run osmo-msc_10.42.42.6(pid=18231): stderr: | 20221212191958086 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212191958086 DLGLOBAL DEBUG validating counter group 0x7f24ad1e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212191958086 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212191958087 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212191958087 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212191958087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212191958089 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212191958089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212191958089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212191958089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:19:59.045305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18224): Terminating (SIGTERM) 19:19:59.084830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18227): Terminating (SIGTERM) 19:19:59.124471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18230): Terminating (SIGTERM) 19:19:59.164163 --- ParallelTerminationStrategy: PID 18224 died... 19:19:59.183368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18224): Terminated: ok {rc=0} 19:19:59.227368 --- ParallelTerminationStrategy: PID 18227 died... 19:19:59.246031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18227): Terminated: ok {rc=0} 19:19:59.289718 --- ParallelTerminationStrategy: PID 18230 died... 19:19:59.308434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18230): Terminated: ok {rc=0} 19:19:59.392146 bus /sierra_3: Setting Powered False 19:20:00.490635 bus /sierra_3: Setting Powered False 19:20:01.617227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:20:02.776172 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:20:02.788703 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:20:02.847401 tst mo_mt_call_osmux.py: using LAC 30945 19:20:02.977039 tst mo_mt_call_osmux.py: using RAC 90 19:20:03.105051 tst mo_mt_call_osmux.py: using CellId 30945 19:20:03.233724 tst mo_mt_call_osmux.py: using BVCI 30946 19:20:03.345419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:20:03.356588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:20:03.367754 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:20:03.378789 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:20:03.389861 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:20:03.400804 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:20:03.519702 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:20:03.638631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:04.113332 run create_hlr_db(pid=18236): Launched 19:20:04.237838 bus /sierra_2: Setting Powered False 19:20:05.299357 run create_hlr_db(pid=18236): Terminated: ok {rc=0} 19:20:05.746887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18238): Launched 19:20:06.075807 run osmo-hlr_10.42.42.2(pid=18239): Launched 19:20:06.202083 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:06.768771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18241): Launched 19:20:07.097653 run osmo-stp_10.42.42.5(pid=18242): Launched 19:20:07.221994 run osmo-msc_10.42.42.6: Starting osmo-msc 19:20:07.816563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18244): Launched 19:20:08.145488 run osmo-msc_10.42.42.6(pid=18245): Launched 19:20:08.319986 run osmo-stp_10.42.42.5(pid=18242): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18242)] 19:20:08.452279 run osmo-stp_10.42.42.5(pid=18242): stdout: | (launched: 2022-12-12_19:20:07.037097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:08.581852 run osmo-stp_10.42.42.5(pid=18242): stderr: | 20221212192007229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192007229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192007230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192007230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192007231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192007231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192007231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:08.709993 run osmo-stp_10.42.42.5(pid=18242): stdout: | (launched: 2022-12-12_19:20:07.037097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:08.831803 run osmo-stp_10.42.42.5(pid=18242): stderr: | 20221212192007229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192007229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192007230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192007230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192007231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192007231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192007231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:08.977616 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18242): Process ended prematurely: osmo-stp_10.42.42.5(pid=18242) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18242)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:20:08.986675 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:20:09.013428 run osmo-hlr_10.42.42.2(pid=18239): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18239)] 19:20:09.061684 run osmo-hlr_10.42.42.2(pid=18239): stdout: | (launched: 2022-12-12_19:20:06.015488) 19:20:09.111403 run osmo-hlr_10.42.42.2(pid=18239): stderr: | 20221212192006212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192006212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192006212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192006212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192006212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192006212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192006226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192006236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192006236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192006236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:09.180641 run osmo-msc_10.42.42.6(pid=18245): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18245)] 19:20:09.228796 run osmo-msc_10.42.42.6(pid=18245): stdout: | (launched: 2022-12-12_19:20:08.084761) 19:20:09.278424 run osmo-msc_10.42.42.6(pid=18245): stderr: | 20221212192008363 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192008363 DLGLOBAL DEBUG validating counter group 0x7fd9084f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192008363 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192008363 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192008363 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192008363 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192008365 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192008366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192008366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192008366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:20:09.328338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18238): Terminating (SIGTERM) 19:20:09.367931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18241): Terminating (SIGTERM) 19:20:09.407758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18244): Terminating (SIGTERM) 19:20:09.448017 --- ParallelTerminationStrategy: PID 18238 died... 19:20:09.467384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18238): Terminated: ok {rc=0} 19:20:09.511952 --- ParallelTerminationStrategy: PID 18241 died... 19:20:09.531088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18241): Terminated: ok {rc=0} 19:20:09.575409 --- ParallelTerminationStrategy: PID 18244 died... 19:20:09.594324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18244): Terminated: ok {rc=0} 19:20:09.681226 bus /sierra_3: Setting Powered False 19:20:10.782420 bus /sierra_3: Setting Powered False 19:20:11.897965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:20:13.136243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:20:13.142805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:20:13.163292 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:20:13.190152 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:20:13.239894 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:20:13.260296 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:20:13.286431 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:20:13.840515 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:20:13.889584 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:13.901224 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:20:13.955465 tst mo_mt_call.py: using LAC 30946 19:20:14.073790 tst mo_mt_call.py: using RAC 91 19:20:14.193684 tst mo_mt_call.py: using CellId 30946 19:20:14.311221 tst mo_mt_call.py: using BVCI 30947 19:20:14.421299 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:14.432222 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:14.443146 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:14.454026 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:14.464787 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:14.475654 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:20:14.595859 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:20:14.718425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:15.229678 run create_hlr_db(pid=18251): Launched 19:20:15.355967 bus /sierra_2: Setting Powered False 19:20:16.421315 run create_hlr_db(pid=18251): Terminated: ok {rc=0} 19:20:16.893456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18253): Launched 19:20:17.239269 run osmo-hlr_10.42.42.2(pid=18254): Launched 19:20:17.366020 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:17.930212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18256): Launched 19:20:18.259550 run osmo-stp_10.42.42.5(pid=18257): Launched 19:20:18.384740 run osmo-msc_10.42.42.6: Starting osmo-msc 19:20:18.981196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18259): Launched 19:20:19.311291 run osmo-msc_10.42.42.6(pid=18260): Launched 19:20:19.495822 run osmo-stp_10.42.42.5(pid=18257): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18257)] 19:20:19.635167 run osmo-stp_10.42.42.5(pid=18257): stdout: | (launched: 2022-12-12_19:20:18.198899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:19.775017 run osmo-stp_10.42.42.5(pid=18257): stderr: | 20221212192018388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192018389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192018389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192018389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192018390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192018390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192018390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:19.912595 run osmo-stp_10.42.42.5(pid=18257): stdout: | (launched: 2022-12-12_19:20:18.198899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:20.043420 run osmo-stp_10.42.42.5(pid=18257): stderr: | 20221212192018388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192018389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192018389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192018389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192018390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192018390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192018390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:20.200568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18257): Process ended prematurely: osmo-stp_10.42.42.5(pid=18257) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18257)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:20:20.210440 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:20:20.239248 run osmo-hlr_10.42.42.2(pid=18254): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18254)] 19:20:20.290532 run osmo-hlr_10.42.42.2(pid=18254): stdout: | (launched: 2022-12-12_19:20:17.177817) 19:20:20.343595 run osmo-hlr_10.42.42.2(pid=18254): stderr: | 20221212192017374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192017374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192017374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192017374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192017375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192017375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192017387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192017395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192017396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192017396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:20.417485 run osmo-msc_10.42.42.6(pid=18260): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18260)] 19:20:20.469162 run osmo-msc_10.42.42.6(pid=18260): stdout: | (launched: 2022-12-12_19:20:19.250637) 19:20:20.522035 run osmo-msc_10.42.42.6(pid=18260): stderr: | 20221212192019571 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192019571 DLGLOBAL DEBUG validating counter group 0x7f044ce80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192019571 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192019571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192019571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192019571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192019573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192019573 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192019574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192019574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:20:20.575344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18253): Terminating (SIGTERM) 19:20:20.617940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18256): Terminating (SIGTERM) 19:20:20.660549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18259): Terminating (SIGTERM) 19:20:20.703527 --- ParallelTerminationStrategy: PID 18253 died... 19:20:20.723823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18253): Terminated: ok {rc=0} 19:20:20.771082 --- ParallelTerminationStrategy: PID 18256 died... 19:20:20.791178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18256): Terminated: ok {rc=0} 19:20:20.838497 --- ParallelTerminationStrategy: PID 18259 died... 19:20:20.858539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18259): Terminated: ok {rc=0} 19:20:20.947419 bus /sierra_3: Setting Powered False 19:20:22.048176 bus /sierra_3: Setting Powered False 19:20:23.167342 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:20:24.315727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:24.327501 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:20:24.383968 tst mo_mt_call_osmux.py: using LAC 30947 19:20:24.506936 tst mo_mt_call_osmux.py: using RAC 92 19:20:24.629194 tst mo_mt_call_osmux.py: using CellId 30947 19:20:24.750553 tst mo_mt_call_osmux.py: using BVCI 30948 19:20:24.871604 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:24.883373 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:24.894921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:24.907018 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:24.919031 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:20:24.930962 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:20:25.047857 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:20:25.171095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:25.684470 run create_hlr_db(pid=18262): Launched 19:20:25.810578 bus /sierra_2: Setting Powered False 19:20:26.875404 run create_hlr_db(pid=18262): Terminated: ok {rc=0} 19:20:27.316061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18264): Launched 19:20:27.624164 run osmo-hlr_10.42.42.2(pid=18265): Launched 19:20:27.741222 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:28.270584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18267): Launched 19:20:28.577284 run osmo-stp_10.42.42.5(pid=18268): Launched 19:20:28.693941 run osmo-msc_10.42.42.6: Starting osmo-msc 19:20:29.250054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18270): Launched 19:20:29.582489 run osmo-msc_10.42.42.6(pid=18271): Launched 19:20:29.766811 run osmo-stp_10.42.42.5(pid=18268): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18268)] 19:20:29.905997 run osmo-stp_10.42.42.5(pid=18268): stdout: | (launched: 2022-12-12_19:20:28.520239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:30.044491 run osmo-stp_10.42.42.5(pid=18268): stderr: | 20221212192028690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192028690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192028690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192028691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192028691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192028691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192028691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:30.182159 run osmo-stp_10.42.42.5(pid=18268): stdout: | (launched: 2022-12-12_19:20:28.520239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:30.313396 run osmo-stp_10.42.42.5(pid=18268): stderr: | 20221212192028690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192028690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192028690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192028691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192028691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192028691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192028691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:30.470551 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18268): Process ended prematurely: osmo-stp_10.42.42.5(pid=18268) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18268)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:20:30.480331 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:20:30.509484 run osmo-hlr_10.42.42.2(pid=18265): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18265)] 19:20:30.560424 run osmo-hlr_10.42.42.2(pid=18265): stdout: | (launched: 2022-12-12_19:20:27.566611) 19:20:30.613287 run osmo-hlr_10.42.42.2(pid=18265): stderr: | 20221212192027743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192027743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192027743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192027743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192027743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192027743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192027756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192027764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192027764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192027765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:30.686924 run osmo-msc_10.42.42.6(pid=18271): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18271)] 19:20:30.737791 run osmo-msc_10.42.42.6(pid=18271): stdout: | (launched: 2022-12-12_19:20:29.522009) 19:20:30.790344 run osmo-msc_10.42.42.6(pid=18271): stderr: | 20221212192029842 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192029843 DLGLOBAL DEBUG validating counter group 0x7fc523b98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192029843 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192029843 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192029843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192029843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192029845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192029845 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192029846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192029846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:20:30.852323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18264): Terminating (SIGTERM) 19:20:30.899204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18267): Terminating (SIGTERM) 19:20:30.953774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18270): Terminating (SIGTERM) 19:20:30.998669 --- ParallelTerminationStrategy: PID 18264 died... 19:20:31.019176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18264): Terminated: ok {rc=0} 19:20:31.071110 --- ParallelTerminationStrategy: PID 18267 died... 19:20:31.090969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18267): Terminated: ok {rc=0} 19:20:31.138630 --- ParallelTerminationStrategy: PID 18270 died... 19:20:31.159041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18270): Terminated: ok {rc=0} 19:20:31.249149 bus /sierra_3: Setting Powered False 19:20:32.348227 bus /sierra_3: Setting Powered False 19:20:33.466215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:20:34.704672 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:20:34.711080 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:20:34.731484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:20:34.758039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:20:34.807911 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:20:34.828407 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:20:34.854791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:20:35.409822 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:20:35.458805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:35.469885 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:20:35.524526 tst mo_mt_call.py: using LAC 30948 19:20:35.643596 tst mo_mt_call.py: using RAC 93 19:20:35.765559 tst mo_mt_call.py: using CellId 30948 19:20:35.886017 tst mo_mt_call.py: using BVCI 30949 19:20:35.996786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:36.007978 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:36.018780 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:36.029647 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:36.040447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:36.051305 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:20:36.170098 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:20:36.291503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:36.803032 run create_hlr_db(pid=18277): Launched 19:20:36.930018 bus /sierra_2: Setting Powered False 19:20:37.995438 run create_hlr_db(pid=18277): Terminated: ok {rc=0} 19:20:38.434800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18279): Launched 19:20:38.742024 run osmo-hlr_10.42.42.2(pid=18280): Launched 19:20:38.858971 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:39.401379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18282): Launched 19:20:39.708291 run osmo-stp_10.42.42.5(pid=18283): Launched 19:20:39.825169 run osmo-msc_10.42.42.6: Starting osmo-msc 19:20:40.379965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18285): Launched 19:20:40.686880 run osmo-msc_10.42.42.6(pid=18286): Launched 19:20:40.857902 run osmo-stp_10.42.42.5(pid=18283): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18283)] 19:20:40.986987 run osmo-stp_10.42.42.5(pid=18283): stdout: | (launched: 2022-12-12_19:20:39.651295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:41.115829 run osmo-stp_10.42.42.5(pid=18283): stderr: | 20221212192039821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192039821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192039822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192039822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192039822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192039823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192039823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:41.242790 run osmo-stp_10.42.42.5(pid=18283): stdout: | (launched: 2022-12-12_19:20:39.651295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:41.364157 run osmo-stp_10.42.42.5(pid=18283): stderr: | 20221212192039821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192039821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192039822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192039822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192039822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192039823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192039823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:41.509917 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18283): Process ended prematurely: osmo-stp_10.42.42.5(pid=18283) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18283)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:20:41.518655 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:20:41.545538 run osmo-hlr_10.42.42.2(pid=18280): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18280)] 19:20:41.593931 run osmo-hlr_10.42.42.2(pid=18280): stdout: | (launched: 2022-12-12_19:20:38.685274) 19:20:41.643773 run osmo-hlr_10.42.42.2(pid=18280): stderr: | 20221212192038860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192038861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192038861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192038861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192038861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192038861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192038873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192038881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192038881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192038881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:41.713483 run osmo-msc_10.42.42.6(pid=18286): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18286)] 19:20:41.761597 run osmo-msc_10.42.42.6(pid=18286): stdout: | (launched: 2022-12-12_19:20:40.630192) 19:20:41.811344 run osmo-msc_10.42.42.6(pid=18286): stderr: | 20221212192040902 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192040902 DLGLOBAL DEBUG validating counter group 0x7f5ae6e33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192040902 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192040902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192040902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192040903 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192040904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192040905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192040905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192040905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:20:41.861669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18279): Terminating (SIGTERM) 19:20:41.901562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18282): Terminating (SIGTERM) 19:20:41.941535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18285): Terminating (SIGTERM) 19:20:41.981874 --- ParallelTerminationStrategy: PID 18279 died... 19:20:42.001328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18279): Terminated: ok {rc=0} 19:20:42.047100 --- ParallelTerminationStrategy: PID 18282 died... 19:20:42.066117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18282): Terminated: ok {rc=0} 19:20:42.110639 --- ParallelTerminationStrategy: PID 18285 died... 19:20:42.129644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18285): Terminated: ok {rc=0} 19:20:42.213511 bus /sierra_3: Setting Powered False 19:20:43.310825 bus /sierra_3: Setting Powered False 19:20:44.424341 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:20:45.574529 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:45.586988 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:20:45.645063 tst mo_mt_call_osmux.py: using LAC 30949 19:20:45.774840 tst mo_mt_call_osmux.py: using RAC 94 19:20:45.930871 tst mo_mt_call_osmux.py: using CellId 30949 19:20:46.093396 tst mo_mt_call_osmux.py: using BVCI 30950 19:20:46.218031 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:46.230826 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:46.243310 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:46.256242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:46.269294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:20:46.283364 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:20:46.408626 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:20:46.529338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:47.049578 run create_hlr_db(pid=18288): Launched 19:20:47.210758 bus /sierra_2: Setting Powered False 19:20:48.275793 run create_hlr_db(pid=18288): Terminated: ok {rc=0} 19:20:48.734468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18290): Launched 19:20:49.064049 run osmo-hlr_10.42.42.2(pid=18291): Launched 19:20:49.190143 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:49.760567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18293): Launched 19:20:50.090298 run osmo-stp_10.42.42.5(pid=18294): Launched 19:20:50.214891 run osmo-msc_10.42.42.6: Starting osmo-msc 19:20:50.809394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18296): Launched 19:20:51.138535 run osmo-msc_10.42.42.6(pid=18297): Launched 19:20:51.321601 run osmo-stp_10.42.42.5(pid=18294): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18294)] 19:20:51.460596 run osmo-stp_10.42.42.5(pid=18294): stdout: | (launched: 2022-12-12_19:20:50.029611) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:51.600224 run osmo-stp_10.42.42.5(pid=18294): stderr: | 20221212192050221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192050222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192050222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192050222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192050223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192050223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192050223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:51.737897 run osmo-stp_10.42.42.5(pid=18294): stdout: | (launched: 2022-12-12_19:20:50.029611) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:51.868785 run osmo-stp_10.42.42.5(pid=18294): stderr: | 20221212192050221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192050222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192050222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192050222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192050223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192050223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192050223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:52.025753 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18294): Process ended prematurely: osmo-stp_10.42.42.5(pid=18294) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18294)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:20:52.035134 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:20:52.063683 run osmo-hlr_10.42.42.2(pid=18291): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18291)] 19:20:52.114596 run osmo-hlr_10.42.42.2(pid=18291): stdout: | (launched: 2022-12-12_19:20:49.003354) 19:20:52.167169 run osmo-hlr_10.42.42.2(pid=18291): stderr: | 20221212192049200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192049200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192049200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192049200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192049200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192049200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192049226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192049236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192049236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192049236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:52.240478 run osmo-msc_10.42.42.6(pid=18297): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18297)] 19:20:52.291237 run osmo-msc_10.42.42.6(pid=18297): stdout: | (launched: 2022-12-12_19:20:51.077736) 19:20:52.343702 run osmo-msc_10.42.42.6(pid=18297): stderr: | 20221212192051399 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192051399 DLGLOBAL DEBUG validating counter group 0x7f6f73973c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192051399 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192051399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192051399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192051400 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192051401 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192051402 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192051402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192051402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:20:52.396717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18290): Terminating (SIGTERM) 19:20:52.439022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18293): Terminating (SIGTERM) 19:20:52.481644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18296): Terminating (SIGTERM) 19:20:52.524692 --- ParallelTerminationStrategy: PID 18290 died... 19:20:52.545392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18290): Terminated: ok {rc=0} 19:20:52.592459 --- ParallelTerminationStrategy: PID 18293 died... 19:20:52.612144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18293): Terminated: ok {rc=0} 19:20:52.659047 --- ParallelTerminationStrategy: PID 18296 died... 19:20:52.678828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18296): Terminated: ok {rc=0} 19:20:52.767322 bus /sierra_3: Setting Powered False 19:20:53.867414 bus /sierra_3: Setting Powered False 19:20:54.985323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:20:56.222110 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:20:56.229055 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:20:56.250669 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:20:56.278350 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:20:56.331730 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:20:56.353088 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:20:56.381083 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:20:56.932152 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:20:56.985198 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:20:56.996714 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:20:57.054302 tst mo_mt_call.py: using LAC 30950 19:20:57.183950 tst mo_mt_call.py: using RAC 95 19:20:57.312097 tst mo_mt_call.py: using CellId 30950 19:20:57.439333 tst mo_mt_call.py: using BVCI 30951 19:20:57.559554 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:20:57.571228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:20:57.582615 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:20:57.594243 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:20:57.605911 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:20:57.617635 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:20:57.736567 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:20:57.859410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:58.372784 run create_hlr_db(pid=18303): Launched 19:20:58.499150 bus /sierra_2: Setting Powered False 19:20:59.564699 run create_hlr_db(pid=18303): Terminated: ok {rc=0} 19:21:00.006400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18305): Launched 19:21:00.314886 run osmo-hlr_10.42.42.2(pid=18306): Launched 19:21:00.432283 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:00.979492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18308): Launched 19:21:01.331110 run osmo-stp_10.42.42.5(pid=18309): Launched 19:21:01.556635 run osmo-msc_10.42.42.6: Starting osmo-msc 19:21:02.244247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18311): Launched 19:21:02.576831 run osmo-msc_10.42.42.6(pid=18312): Launched 19:21:02.760501 run osmo-stp_10.42.42.5(pid=18309): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18309)] 19:21:02.899495 run osmo-stp_10.42.42.5(pid=18309): stdout: | (launched: 2022-12-12_19:21:01.267256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:03.039309 run osmo-stp_10.42.42.5(pid=18309): stderr: | 20221212192101539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192101540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192101540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192101540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192101541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192101541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192101541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:03.177806 run osmo-stp_10.42.42.5(pid=18309): stdout: | (launched: 2022-12-12_19:21:01.267256) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:03.309250 run osmo-stp_10.42.42.5(pid=18309): stderr: | 20221212192101539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192101540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192101540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192101540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192101541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192101541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192101541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:03.467594 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18309): Process ended prematurely: osmo-stp_10.42.42.5(pid=18309) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18309)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:21:03.477230 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:21:03.506188 run osmo-hlr_10.42.42.2(pid=18306): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18306)] 19:21:03.557672 run osmo-hlr_10.42.42.2(pid=18306): stdout: | (launched: 2022-12-12_19:21:00.257517) 19:21:03.610949 run osmo-hlr_10.42.42.2(pid=18306): stderr: | 20221212192100433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192100433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192100433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192100433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192100434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192100434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192100450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192100459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192100460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192100460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:03.685148 run osmo-msc_10.42.42.6(pid=18312): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18312)] 19:21:03.736542 run osmo-msc_10.42.42.6(pid=18312): stdout: | (launched: 2022-12-12_19:21:02.515225) 19:21:03.789562 run osmo-msc_10.42.42.6(pid=18312): stderr: | 20221212192102838 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192102838 DLGLOBAL DEBUG validating counter group 0x7f6c32bc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192102838 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192102838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192102838 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192102839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192102840 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192102841 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192102841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192102841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:21:03.843114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18305): Terminating (SIGTERM) 19:21:03.885942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18308): Terminating (SIGTERM) 19:21:03.928671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18311): Terminating (SIGTERM) 19:21:03.971840 --- ParallelTerminationStrategy: PID 18305 died... 19:21:03.992260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18305): Terminated: ok {rc=0} 19:21:04.040015 --- ParallelTerminationStrategy: PID 18308 died... 19:21:04.059912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18308): Terminated: ok {rc=0} 19:21:04.107356 --- ParallelTerminationStrategy: PID 18311 died... 19:21:04.127189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18311): Terminated: ok {rc=0} 19:21:04.217354 bus /sierra_3: Setting Powered False 19:21:05.318722 bus /sierra_3: Setting Powered False 19:21:06.436849 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:21:07.589798 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:21:07.602127 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:21:07.660108 tst mo_mt_call_osmux.py: using LAC 30951 19:21:07.789368 tst mo_mt_call_osmux.py: using RAC 96 19:21:07.918729 tst mo_mt_call_osmux.py: using CellId 30951 19:21:08.047221 tst mo_mt_call_osmux.py: using BVCI 30952 19:21:08.166891 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:21:08.178564 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:21:08.190061 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:21:08.201837 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:21:08.213675 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:21:08.225296 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:21:08.345443 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:21:08.467059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:08.979599 run create_hlr_db(pid=18314): Launched 19:21:09.105194 bus /sierra_2: Setting Powered False 19:21:10.170667 run create_hlr_db(pid=18314): Terminated: ok {rc=0} 19:21:10.611183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18316): Launched 19:21:10.920816 run osmo-hlr_10.42.42.2(pid=18317): Launched 19:21:11.038752 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:11.569443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18319): Launched 19:21:11.875464 run osmo-stp_10.42.42.5(pid=18320): Launched 19:21:11.992506 run osmo-msc_10.42.42.6: Starting osmo-msc 19:21:12.548652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18322): Launched 19:21:12.856166 run osmo-msc_10.42.42.6(pid=18323): Launched 19:21:13.027056 run osmo-stp_10.42.42.5(pid=18320): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18320)] 19:21:13.156573 run osmo-stp_10.42.42.5(pid=18320): stdout: | (launched: 2022-12-12_19:21:11.818621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:13.287035 run osmo-stp_10.42.42.5(pid=18320): stderr: | 20221212192111985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192111985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192111985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192111986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192111986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192111986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192111986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:13.414315 run osmo-stp_10.42.42.5(pid=18320): stdout: | (launched: 2022-12-12_19:21:11.818621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:13.535937 run osmo-stp_10.42.42.5(pid=18320): stderr: | 20221212192111985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192111985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192111985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192111986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192111986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192111986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192111986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:13.681533 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18320): Process ended prematurely: osmo-stp_10.42.42.5(pid=18320) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18320)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:21:13.690445 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:21:13.717094 run osmo-hlr_10.42.42.2(pid=18317): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18317)] 19:21:13.764869 run osmo-hlr_10.42.42.2(pid=18317): stdout: | (launched: 2022-12-12_19:21:10.863632) 19:21:13.815140 run osmo-hlr_10.42.42.2(pid=18317): stderr: | 20221212192111040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192111040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192111040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192111040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192111040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192111040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192111053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192111061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192111061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192111061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:13.885050 run osmo-msc_10.42.42.6(pid=18323): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18323)] 19:21:13.933355 run osmo-msc_10.42.42.6(pid=18323): stdout: | (launched: 2022-12-12_19:21:12.798883) 19:21:13.983246 run osmo-msc_10.42.42.6(pid=18323): stderr: | 20221212192113070 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192113070 DLGLOBAL DEBUG validating counter group 0x7fb3ee1c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192113070 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192113070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192113070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192113071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192113072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192113073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192113073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192113073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:21:14.033667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18316): Terminating (SIGTERM) 19:21:14.073582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18319): Terminating (SIGTERM) 19:21:14.113336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18322): Terminating (SIGTERM) 19:21:14.153549 --- ParallelTerminationStrategy: PID 18316 died... 19:21:14.172701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18316): Terminated: ok {rc=0} 19:21:14.218130 --- ParallelTerminationStrategy: PID 18319 died... 19:21:14.236922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18319): Terminated: ok {rc=0} 19:21:14.281959 --- ParallelTerminationStrategy: PID 18322 died... 19:21:14.300904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18322): Terminated: ok {rc=0} 19:21:14.385162 bus /sierra_3: Setting Powered False 19:21:15.481789 bus /sierra_3: Setting Powered False 19:21:16.597649 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:21:17.842116 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:21:17.848929 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:21:17.871640 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:21:17.899329 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:21:17.954998 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:21:17.975584 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:21:18.002130 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:21:18.552366 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:21:18.606722 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:18.618318 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:21:18.677567 tst mo_mt_call.py: using LAC 30952 19:21:18.799515 tst mo_mt_call.py: using RAC 97 19:21:18.921927 tst mo_mt_call.py: using CellId 30952 19:21:19.045765 tst mo_mt_call.py: using BVCI 30953 19:21:19.167634 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:19.179427 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:19.190963 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:19.203006 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:19.215030 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:19.226932 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:21:19.343780 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:21:19.463468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:19.975155 run create_hlr_db(pid=18328): Launched 19:21:20.100554 bus /sierra_2: Setting Powered False 19:21:21.165784 run create_hlr_db(pid=18328): Terminated: ok {rc=0} 19:21:21.606714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18330): Launched 19:21:21.936535 run osmo-hlr_10.42.42.2(pid=18331): Launched 19:21:22.066958 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:22.635543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18333): Launched 19:21:22.967384 run osmo-stp_10.42.42.5(pid=18334): Launched 19:21:23.093491 run osmo-msc_10.42.42.6: Starting osmo-msc 19:21:23.691809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18336): Launched 19:21:24.022513 run osmo-msc_10.42.42.6(pid=18337): Launched 19:21:24.206102 run osmo-stp_10.42.42.5(pid=18334): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18334)] 19:21:24.345486 run osmo-stp_10.42.42.5(pid=18334): stdout: | (launched: 2022-12-12_19:21:22.906633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:24.485591 run osmo-stp_10.42.42.5(pid=18334): stderr: | 20221212192123099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192123099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192123099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192123100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192123100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192123100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192123100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:24.623795 run osmo-stp_10.42.42.5(pid=18334): stdout: | (launched: 2022-12-12_19:21:22.906633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:24.755144 run osmo-stp_10.42.42.5(pid=18334): stderr: | 20221212192123099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192123099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192123099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192123100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192123100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192123100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192123100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:24.912180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18334): Process ended prematurely: osmo-stp_10.42.42.5(pid=18334) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18334)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:21:24.921876 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:21:24.950396 run osmo-hlr_10.42.42.2(pid=18331): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18331)] 19:21:25.001666 run osmo-hlr_10.42.42.2(pid=18331): stdout: | (launched: 2022-12-12_19:21:21.856646) 19:21:25.054669 run osmo-hlr_10.42.42.2(pid=18331): stderr: | 20221212192122069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192122069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192122069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192122069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192122069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192122069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192122082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192122092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192122093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192122093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:25.128679 run osmo-msc_10.42.42.6(pid=18337): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18337)] 19:21:25.179996 run osmo-msc_10.42.42.6(pid=18337): stdout: | (launched: 2022-12-12_19:21:23.961577) 19:21:25.232676 run osmo-msc_10.42.42.6(pid=18337): stderr: | 20221212192124281 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192124282 DLGLOBAL DEBUG validating counter group 0x7f4443899c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192124282 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192124282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192124282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192124282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192124284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192124284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192124284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192124284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:21:25.286042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18330): Terminating (SIGTERM) 19:21:25.328889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18333): Terminating (SIGTERM) 19:21:25.371702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18336): Terminating (SIGTERM) 19:21:25.414681 --- ParallelTerminationStrategy: PID 18330 died... 19:21:25.435071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18330): Terminated: ok {rc=0} 19:21:25.482884 --- ParallelTerminationStrategy: PID 18333 died... 19:21:25.502841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18333): Terminated: ok {rc=0} 19:21:25.550236 --- ParallelTerminationStrategy: PID 18336 died... 19:21:25.570035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18336): Terminated: ok {rc=0} 19:21:25.660346 bus /sierra_3: Setting Powered False 19:21:26.761004 bus /sierra_3: Setting Powered False 19:21:27.879826 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:21:29.030888 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:29.043235 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:21:29.102519 tst mo_mt_call_osmux.py: using LAC 30953 19:21:29.231373 tst mo_mt_call_osmux.py: using RAC 98 19:21:29.361037 tst mo_mt_call_osmux.py: using CellId 30953 19:21:29.490573 tst mo_mt_call_osmux.py: using BVCI 30954 19:21:29.610462 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:29.622571 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:29.634151 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:29.646539 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:29.658940 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:21:29.671210 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:21:29.788501 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:21:29.910596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:30.422505 run create_hlr_db(pid=18339): Launched 19:21:30.548329 bus /sierra_2: Setting Powered False 19:21:31.620355 run create_hlr_db(pid=18339): Terminated: ok {rc=0} 19:21:32.061623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18341): Launched 19:21:32.375453 run osmo-hlr_10.42.42.2(pid=18342): Launched 19:21:32.494063 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:33.027114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18344): Launched 19:21:33.334617 run osmo-stp_10.42.42.5(pid=18345): Launched 19:21:33.450937 run osmo-msc_10.42.42.6: Starting osmo-msc 19:21:34.005565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18347): Launched 19:21:34.312293 run osmo-msc_10.42.42.6(pid=18348): Launched 19:21:34.484373 run osmo-stp_10.42.42.5(pid=18345): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18345)] 19:21:34.614223 run osmo-stp_10.42.42.5(pid=18345): stdout: | (launched: 2022-12-12_19:21:33.277321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:34.743719 run osmo-stp_10.42.42.5(pid=18345): stderr: | 20221212192133447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192133448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192133448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192133448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192133449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192133449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192133449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:34.871108 run osmo-stp_10.42.42.5(pid=18345): stdout: | (launched: 2022-12-12_19:21:33.277321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:34.992466 run osmo-stp_10.42.42.5(pid=18345): stderr: | 20221212192133447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192133448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192133448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192133448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192133449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192133449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192133449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:35.138317 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18345): Process ended prematurely: osmo-stp_10.42.42.5(pid=18345) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18345)] [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:21:35.147129 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:21:35.173774 run osmo-hlr_10.42.42.2(pid=18342): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18342)] 19:21:35.221976 run osmo-hlr_10.42.42.2(pid=18342): stdout: | (launched: 2022-12-12_19:21:32.318432) 19:21:35.272024 run osmo-hlr_10.42.42.2(pid=18342): stderr: | 20221212192132491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192132491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192132491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192132491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192132491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192132491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192132503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192132511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192132512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192132512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:35.342528 run osmo-msc_10.42.42.6(pid=18348): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18348)] 19:21:35.391011 run osmo-msc_10.42.42.6(pid=18348): stdout: | (launched: 2022-12-12_19:21:34.255248) 19:21:35.441180 run osmo-msc_10.42.42.6(pid=18348): stderr: | 20221212192134527 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192134527 DLGLOBAL DEBUG validating counter group 0x7f0bbe3bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192134527 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192134527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192134527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192134528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192134529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192134530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192134530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192134530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:21:35.491385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18341): Terminating (SIGTERM) 19:21:35.531426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18344): Terminating (SIGTERM) 19:21:35.571491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18347): Terminating (SIGTERM) 19:21:35.611995 --- ParallelTerminationStrategy: PID 18341 died... 19:21:35.631440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18341): Terminated: ok {rc=0} 19:21:35.675942 --- ParallelTerminationStrategy: PID 18344 died... 19:21:35.694822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18344): Terminated: ok {rc=0} 19:21:35.739245 --- ParallelTerminationStrategy: PID 18347 died... 19:21:35.758184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18347): Terminated: ok {rc=0} 19:21:35.844532 bus /sierra_3: Setting Powered False 19:21:36.945711 bus /sierra_3: Setting Powered False 19:21:38.060102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:21:39.301954 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:21:39.308873 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:21:39.329724 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:21:39.356164 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:21:39.408034 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:21:39.428540 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:21:39.454859 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:21:40.007979 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:21:40.057543 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:40.068603 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:21:40.125222 tst mo_mt_call.py: using LAC 30954 19:21:40.247374 tst mo_mt_call.py: using RAC 99 19:21:40.369056 tst mo_mt_call.py: using CellId 30954 19:21:40.490831 tst mo_mt_call.py: using BVCI 30955 19:21:40.603101 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:40.614255 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:40.625203 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:40.636060 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:40.646989 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:40.658004 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:21:40.771891 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:21:40.887599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:41.365573 run create_hlr_db(pid=18353): Launched 19:21:41.491749 bus /sierra_2: Setting Powered False 19:21:42.553757 run create_hlr_db(pid=18353): Terminated: ok {rc=0} 19:21:43.004769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18355): Launched 19:21:43.335980 run osmo-hlr_10.42.42.2(pid=18356): Launched 19:21:43.462573 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:44.030267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18358): Launched 19:21:44.360405 run osmo-stp_10.42.42.5(pid=18359): Launched 19:21:44.486731 run osmo-msc_10.42.42.6: Starting osmo-msc 19:21:45.083427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18361): Launched 19:21:45.414710 run osmo-msc_10.42.42.6(pid=18362): Launched 19:21:45.599414 run osmo-stp_10.42.42.5(pid=18359): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18359)] 19:21:45.739448 run osmo-stp_10.42.42.5(pid=18359): stdout: | (launched: 2022-12-12_19:21:44.299338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:45.926331 run osmo-stp_10.42.42.5(pid=18359): stderr: | 20221212192144490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192144490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192144490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192144490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192144491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192144491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192144491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:46.057190 run osmo-stp_10.42.42.5(pid=18359): stdout: | (launched: 2022-12-12_19:21:44.299338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:46.183090 run osmo-stp_10.42.42.5(pid=18359): stderr: | 20221212192144490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192144490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192144490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192144490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192144491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192144491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192144491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:46.334949 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18359): Process ended prematurely: osmo-stp_10.42.42.5(pid=18359) [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18359)] [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:21:46.345510 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:21:46.374251 run osmo-hlr_10.42.42.2(pid=18356): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18356)] 19:21:46.425347 run osmo-hlr_10.42.42.2(pid=18356): stdout: | (launched: 2022-12-12_19:21:43.275341) 19:21:46.477470 run osmo-hlr_10.42.42.2(pid=18356): stderr: | 20221212192143473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192143473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192143473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192143473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192143473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192143473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192143484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192143493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192143493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192143493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:46.549500 run osmo-msc_10.42.42.6(pid=18362): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18362)] 19:21:46.599522 run osmo-msc_10.42.42.6(pid=18362): stdout: | (launched: 2022-12-12_19:21:45.353583) 19:21:46.651361 run osmo-msc_10.42.42.6(pid=18362): stderr: | 20221212192145675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192145675 DLGLOBAL DEBUG validating counter group 0x7fc205578c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192145675 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192145675 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192145675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192145675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192145677 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192145678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192145678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192145678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:21:46.704152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18355): Terminating (SIGTERM) 19:21:46.746874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18358): Terminating (SIGTERM) 19:21:46.791880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18361): Terminating (SIGTERM) 19:21:46.835968 --- ParallelTerminationStrategy: PID 18355 died... 19:21:46.856030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18355): Terminated: ok {rc=0} 19:21:46.903790 --- ParallelTerminationStrategy: PID 18358 died... 19:21:46.923378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18358): Terminated: ok {rc=0} 19:21:46.970027 --- ParallelTerminationStrategy: PID 18361 died... 19:21:46.990168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18361): Terminated: ok {rc=0} 19:21:47.076482 bus /sierra_3: Setting Powered False 19:21:48.174897 bus /sierra_3: Setting Powered False 19:21:49.290598 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:21:50.438671 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:50.450627 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:21:50.508371 tst mo_mt_call_osmux.py: using LAC 30955 19:21:50.630156 tst mo_mt_call_osmux.py: using RAC 100 19:21:50.751812 tst mo_mt_call_osmux.py: using CellId 30955 19:21:50.877403 tst mo_mt_call_osmux.py: using BVCI 30956 19:21:50.989565 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:51.000752 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:51.011908 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:51.022977 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:51.034069 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:21:51.045259 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:21:51.165167 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:21:51.284164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:51.761361 run create_hlr_db(pid=18364): Launched 19:21:51.886076 bus /sierra_2: Setting Powered False 19:21:52.947604 run create_hlr_db(pid=18364): Terminated: ok {rc=0} 19:21:53.397992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18366): Launched 19:21:53.729599 run osmo-hlr_10.42.42.2(pid=18367): Launched 19:21:53.854687 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:54.423869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18369): Launched 19:21:54.755610 run osmo-stp_10.42.42.5(pid=18370): Launched 19:21:54.880239 run osmo-msc_10.42.42.6: Starting osmo-msc 19:21:55.474810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18372): Launched 19:21:55.805899 run osmo-msc_10.42.42.6(pid=18373): Launched 19:21:55.989203 run osmo-stp_10.42.42.5(pid=18370): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18370)] 19:21:56.127893 run osmo-stp_10.42.42.5(pid=18370): stdout: | (launched: 2022-12-12_19:21:54.693485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:56.266967 run osmo-stp_10.42.42.5(pid=18370): stderr: | 20221212192154885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192154885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192154886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192154886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192154886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192154887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192154887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:56.404806 run osmo-stp_10.42.42.5(pid=18370): stdout: | (launched: 2022-12-12_19:21:54.693485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:56.536647 run osmo-stp_10.42.42.5(pid=18370): stderr: | 20221212192154885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192154885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192154886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192154886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192154886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192154887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192154887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:56.693862 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18370): Process ended prematurely: osmo-stp_10.42.42.5(pid=18370) [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18370)] [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:21:56.703601 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:21:56.732433 run osmo-hlr_10.42.42.2(pid=18367): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18367)] 19:21:56.783008 run osmo-hlr_10.42.42.2(pid=18367): stdout: | (launched: 2022-12-12_19:21:53.668481) 19:21:56.835275 run osmo-hlr_10.42.42.2(pid=18367): stderr: | 20221212192153868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192153868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192153868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192153868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192153868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192153868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192153880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192153890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192153891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192153891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:56.908089 run osmo-msc_10.42.42.6(pid=18373): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18373)] 19:21:56.958773 run osmo-msc_10.42.42.6(pid=18373): stdout: | (launched: 2022-12-12_19:21:55.744387) 19:21:57.011657 run osmo-msc_10.42.42.6(pid=18373): stderr: | 20221212192156066 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192156066 DLGLOBAL DEBUG validating counter group 0x7f0de663dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192156066 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192156066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192156066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192156066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192156068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192156068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192156068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192156069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:21:57.064191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18366): Terminating (SIGTERM) 19:21:57.106379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18369): Terminating (SIGTERM) 19:21:57.148491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18372): Terminating (SIGTERM) 19:21:57.191138 --- ParallelTerminationStrategy: PID 18366 died... 19:21:57.211394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18366): Terminated: ok {rc=0} 19:21:57.258611 --- ParallelTerminationStrategy: PID 18369 died... 19:21:57.278577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18369): Terminated: ok {rc=0} 19:21:57.325633 --- ParallelTerminationStrategy: PID 18372 died... 19:21:57.345427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18372): Terminated: ok {rc=0} 19:21:57.434229 bus /sierra_3: Setting Powered False 19:21:58.533929 bus /sierra_3: Setting Powered False 19:21:59.649816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:22:00.891331 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:00.897216 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:22:00.919245 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:22:00.946964 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:22:01.008750 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:22:01.034006 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:22:01.062891 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:22:01.613196 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:22:01.690387 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:01.707637 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:22:01.769753 tst mo_mt_call.py: using LAC 30956 19:22:01.925192 tst mo_mt_call.py: using RAC 101 19:22:02.085458 tst mo_mt_call.py: using CellId 30956 19:22:02.205292 tst mo_mt_call.py: using BVCI 30957 19:22:02.328127 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:02.340903 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:02.352887 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:02.367051 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:02.380384 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:02.393219 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:22:02.512430 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:22:02.631793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:03.143183 run create_hlr_db(pid=18378): Launched 19:22:03.268247 bus /sierra_2: Setting Powered False 19:22:04.333748 run create_hlr_db(pid=18378): Terminated: ok {rc=0} 19:22:04.774593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18380): Launched 19:22:05.082152 run osmo-hlr_10.42.42.2(pid=18381): Launched 19:22:05.197923 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:05.726780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18383): Launched 19:22:06.034563 run osmo-stp_10.42.42.5(pid=18384): Launched 19:22:06.151247 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:06.706012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18386): Launched 19:22:07.012754 run osmo-msc_10.42.42.6(pid=18387): Launched 19:22:07.198990 run osmo-stp_10.42.42.5(pid=18384): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18384)] 19:22:07.342164 run osmo-stp_10.42.42.5(pid=18384): stdout: | (launched: 2022-12-12_19:22:05.977582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:07.480201 run osmo-stp_10.42.42.5(pid=18384): stderr: | 20221212192206145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192206145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192206146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192206146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192206147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192206147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192206147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:07.619087 run osmo-stp_10.42.42.5(pid=18384): stdout: | (launched: 2022-12-12_19:22:05.977582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:07.751086 run osmo-stp_10.42.42.5(pid=18384): stderr: | 20221212192206145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192206145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192206146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192206146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192206147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192206147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192206147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:07.908528 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18384): Process ended prematurely: osmo-stp_10.42.42.5(pid=18384) [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18384)] [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:22:07.918542 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:22:07.947599 run osmo-hlr_10.42.42.2(pid=18381): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18381)] 19:22:07.999826 run osmo-hlr_10.42.42.2(pid=18381): stdout: | (launched: 2022-12-12_19:22:05.024589) 19:22:08.053289 run osmo-hlr_10.42.42.2(pid=18381): stderr: | 20221212192205199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192205199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192205199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192205199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192205199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192205199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192205212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192205221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192205221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192205222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:08.127364 run osmo-msc_10.42.42.6(pid=18387): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18387)] 19:22:08.178984 run osmo-msc_10.42.42.6(pid=18387): stdout: | (launched: 2022-12-12_19:22:06.955455) 19:22:08.231571 run osmo-msc_10.42.42.6(pid=18387): stderr: | 20221212192207270 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192207271 DLGLOBAL DEBUG validating counter group 0x7fdb814fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192207271 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192207271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192207271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192207271 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192207273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192207273 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192207274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192207274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:08.284528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18380): Terminating (SIGTERM) 19:22:08.327075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18383): Terminating (SIGTERM) 19:22:08.369863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18386): Terminating (SIGTERM) 19:22:08.413592 --- ParallelTerminationStrategy: PID 18380 died... 19:22:08.433909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18380): Terminated: ok {rc=0} 19:22:08.481910 --- ParallelTerminationStrategy: PID 18383 died... 19:22:08.502465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18383): Terminated: ok {rc=0} 19:22:08.550541 --- ParallelTerminationStrategy: PID 18386 died... 19:22:08.570602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18386): Terminated: ok {rc=0} 19:22:08.661273 bus /sierra_3: Setting Powered False 19:22:09.762819 bus /sierra_3: Setting Powered False 19:22:10.882411 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:22:12.035189 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:12.047537 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:22:12.109785 tst mo_mt_call_osmux.py: using LAC 30957 19:22:12.241147 tst mo_mt_call_osmux.py: using RAC 102 19:22:12.369375 tst mo_mt_call_osmux.py: using CellId 30957 19:22:12.496286 tst mo_mt_call_osmux.py: using BVCI 30958 19:22:12.615755 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:12.627574 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:12.639040 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:12.650923 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:12.662871 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:22:12.675170 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:22:12.792871 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:22:12.915004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:13.427178 run create_hlr_db(pid=18389): Launched 19:22:13.553456 bus /sierra_2: Setting Powered False 19:22:14.617706 run create_hlr_db(pid=18389): Terminated: ok {rc=0} 19:22:15.056564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18391): Launched 19:22:15.363552 run osmo-hlr_10.42.42.2(pid=18392): Launched 19:22:15.479772 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:16.056660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18394): Launched 19:22:16.384660 run osmo-stp_10.42.42.5(pid=18395): Launched 19:22:16.575140 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:17.245250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18397): Launched 19:22:17.566169 run osmo-msc_10.42.42.6(pid=18398): Launched 19:22:17.740041 run osmo-stp_10.42.42.5(pid=18395): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18395)] 19:22:17.870093 run osmo-stp_10.42.42.5(pid=18395): stdout: | (launched: 2022-12-12_19:22:16.324064) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:18.000134 run osmo-stp_10.42.42.5(pid=18395): stderr: | 20221212192216668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192216668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192216668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192216677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192216678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192216678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192216678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:18.127949 run osmo-stp_10.42.42.5(pid=18395): stdout: | (launched: 2022-12-12_19:22:16.324064) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:18.250043 run osmo-stp_10.42.42.5(pid=18395): stderr: | 20221212192216668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192216668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192216668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192216677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192216678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192216678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192216678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:18.396381 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18395): Process ended prematurely: osmo-stp_10.42.42.5(pid=18395) [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18395)] [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:22:18.405606 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:22:18.432587 run osmo-hlr_10.42.42.2(pid=18392): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18392)] 19:22:18.480917 run osmo-hlr_10.42.42.2(pid=18392): stdout: | (launched: 2022-12-12_19:22:15.306253) 19:22:18.530929 run osmo-hlr_10.42.42.2(pid=18392): stderr: | 20221212192215481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192215481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192215481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192215481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192215481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192215481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192215494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192215502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192215502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192215502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:18.600731 run osmo-msc_10.42.42.6(pid=18398): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18398)] 19:22:18.649110 run osmo-msc_10.42.42.6(pid=18398): stdout: | (launched: 2022-12-12_19:22:17.508645) 19:22:18.698809 run osmo-msc_10.42.42.6(pid=18398): stderr: | 20221212192217780 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192217780 DLGLOBAL DEBUG validating counter group 0x7f5f4e134c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192217780 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192217780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192217780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192217781 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192217782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192217783 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192217783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192217783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:18.749081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18391): Terminating (SIGTERM) 19:22:18.789052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18394): Terminating (SIGTERM) 19:22:18.829304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18397): Terminating (SIGTERM) 19:22:18.869731 --- ParallelTerminationStrategy: PID 18391 died... 19:22:18.889107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18391): Terminated: ok {rc=0} 19:22:18.933471 --- ParallelTerminationStrategy: PID 18394 died... 19:22:18.951989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18394): Terminated: ok {rc=0} 19:22:18.996799 --- ParallelTerminationStrategy: PID 18397 died... 19:22:19.016114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18397): Terminated: ok {rc=0} 19:22:19.103346 bus /sierra_3: Setting Powered False 19:22:20.205805 bus /sierra_3: Setting Powered False 19:22:21.323271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:oc2g --------------------------------------------------------------------- 19:22:22.564816 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:22.569647 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 19:22:22.590913 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 19:22:22.620157 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 19:22:22.706540 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 19:22:22.727840 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 19:22:22.755342 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 19:22:23.339402 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 19:22:23.344614 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:23.355633 tst emergency:oc2g: Using 1 x bts (candidates: 1) 19:22:23.392630 tst emergency_mo_mt_call.py: using LAC 30958 19:22:23.519433 tst emergency_mo_mt_call.py: using RAC 103 19:22:23.645426 tst emergency_mo_mt_call.py: using CellId 30958 19:22:23.766138 tst emergency_mo_mt_call.py: using BVCI 30959 19:22:23.876245 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:23.887234 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:23.898072 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:23.908880 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:23.919767 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:23.930563 tst emergency:oc2g: Using 1 x modem (candidates: 4) 19:22:24.049915 tst emergency:oc2g: Using 1 x modem (candidates: 4) 19:22:24.170006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:24.674449 run create_hlr_db(pid=18404): Launched 19:22:24.797852 bus /sierra_2: Setting Powered False 19:22:25.862140 run create_hlr_db(pid=18404): Terminated: ok {rc=0} 19:22:26.315489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18406): Launched 19:22:26.643547 run osmo-hlr_10.42.42.2(pid=18407): Launched 19:22:26.767196 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:27.324608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18409): Launched 19:22:27.649832 run osmo-stp_10.42.42.5(pid=18410): Launched 19:22:27.783046 tst emergency_mo_mt_call.py: using MSISDN 7932 19:22:27.954295 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:28.538848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18412): Launched 19:22:28.864056 run osmo-msc_10.42.42.6(pid=18413): Launched 19:22:29.045460 run osmo-stp_10.42.42.5(pid=18410): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18410)] 19:22:29.183090 run osmo-stp_10.42.42.5(pid=18410): stdout: | (launched: 2022-12-12_19:22:27.589855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:29.320628 run osmo-stp_10.42.42.5(pid=18410): stderr: | 20221212192227781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192227781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192227781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192227782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192227782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192227782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192227782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:29.456478 run osmo-stp_10.42.42.5(pid=18410): stdout: | (launched: 2022-12-12_19:22:27.589855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:29.586764 run osmo-stp_10.42.42.5(pid=18410): stderr: | 20221212192227781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192227781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192227781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192227782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192227782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192227782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192227782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:29.741402 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18410): Process ended prematurely: osmo-stp_10.42.42.5(pid=18410) [trial-2381↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18410)] [trial-2381↪emergency:oc2g↪emergency_mo_mt_call.py:19] 19:22:29.750397 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 19:22:29.778729 run osmo-hlr_10.42.42.2(pid=18407): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18407)] 19:22:29.829910 run osmo-hlr_10.42.42.2(pid=18407): stdout: | (launched: 2022-12-12_19:22:26.583610) 19:22:29.882938 run osmo-hlr_10.42.42.2(pid=18407): stderr: | 20221212192226779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192226779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192226779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192226779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192226779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192226779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192226792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192226800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192226800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192226800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:29.956468 run osmo-msc_10.42.42.6(pid=18413): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18413)] 19:22:30.007677 run osmo-msc_10.42.42.6(pid=18413): stdout: | (launched: 2022-12-12_19:22:28.803989) 19:22:30.060486 run osmo-msc_10.42.42.6(pid=18413): stderr: | 20221212192229123 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192229123 DLGLOBAL DEBUG validating counter group 0x7f00250abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192229123 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192229123 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192229124 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192229124 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192229126 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192229126 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192229126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192229126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:30.113883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18406): Terminating (SIGTERM) 19:22:30.156741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18409): Terminating (SIGTERM) 19:22:30.199356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18412): Terminating (SIGTERM) 19:22:30.242287 --- ParallelTerminationStrategy: PID 18406 died... 19:22:30.262573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18406): Terminated: ok {rc=0} 19:22:30.310127 --- ParallelTerminationStrategy: PID 18409 died... 19:22:30.330089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18409): Terminated: ok {rc=0} 19:22:30.377423 --- ParallelTerminationStrategy: PID 18412 died... 19:22:30.397694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18412): Terminated: ok {rc=0} 19:22:30.487030 bus /sierra_3: Setting Powered False 19:22:31.585972 bus /sierra_3: Setting Powered False 19:22:32.705764 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 19:22:33.793640 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:33.805747 tst emergency:oc2g: Using 1 x bts (candidates: 1) 19:22:33.844270 tst emergency_preemptive_call.py: using LAC 30959 19:22:33.964638 tst emergency_preemptive_call.py: using RAC 104 19:22:34.085415 tst emergency_preemptive_call.py: using CellId 30959 19:22:34.204820 tst emergency_preemptive_call.py: using BVCI 30960 19:22:34.313639 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:34.324088 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:34.334594 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:34.345463 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:34.356014 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 19:22:34.366587 tst emergency:oc2g: Using 1 x modem (candidates: 4) 19:22:34.481403 tst emergency:oc2g: Using 1 x modem (candidates: 4) 19:22:34.602234 tst emergency:oc2g: Using 1 x modem (candidates: 4) 19:22:34.718833 tst emergency:oc2g: Using 1 x modem (candidates: 4) 19:22:34.837680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:35.308092 run create_hlr_db(pid=18415): Launched 19:22:35.431321 bus /sierra_2: Setting Powered False 19:22:36.491839 run create_hlr_db(pid=18415): Terminated: ok {rc=0} 19:22:36.936361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18417): Launched 19:22:37.262113 run osmo-hlr_10.42.42.2(pid=18418): Launched 19:22:37.386413 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:37.958511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18420): Launched 19:22:38.282912 run osmo-stp_10.42.42.5(pid=18421): Launched 19:22:38.416260 tst emergency_preemptive_call.py: using MSISDN 7933 19:22:38.583005 run osmo-msc_10.42.42.6: Starting osmo-msc 19:22:39.163970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18423): Launched 19:22:39.488451 run osmo-msc_10.42.42.6(pid=18424): Launched 19:22:39.669392 run osmo-stp_10.42.42.5(pid=18421): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18421)] 19:22:39.807794 run osmo-stp_10.42.42.5(pid=18421): stdout: | (launched: 2022-12-12_19:22:38.222966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:39.945340 run osmo-stp_10.42.42.5(pid=18421): stderr: | 20221212192238413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192238414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192238414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192238414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192238415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192238415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192238415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:40.083309 run osmo-stp_10.42.42.5(pid=18421): stdout: | (launched: 2022-12-12_19:22:38.222966) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:40.212509 run osmo-stp_10.42.42.5(pid=18421): stderr: | 20221212192238413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192238414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192238414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192238414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192238415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192238415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192238415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:40.367629 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18421): Process ended prematurely: osmo-stp_10.42.42.5(pid=18421) [trial-2381↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18421)] [trial-2381↪emergency:oc2g↪emergency_preemptive_call.py:32] 19:22:40.376469 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 19:22:40.404922 run osmo-hlr_10.42.42.2(pid=18418): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18418)] 19:22:40.456166 run osmo-hlr_10.42.42.2(pid=18418): stdout: | (launched: 2022-12-12_19:22:37.202149) 19:22:40.509277 run osmo-hlr_10.42.42.2(pid=18418): stderr: | 20221212192237398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192237398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192237398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192237398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192237398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192237398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192237411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192237422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192237422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192237422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:40.582591 run osmo-msc_10.42.42.6(pid=18424): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18424)] 19:22:40.633432 run osmo-msc_10.42.42.6(pid=18424): stdout: | (launched: 2022-12-12_19:22:39.428283) 19:22:40.685796 run osmo-msc_10.42.42.6(pid=18424): stderr: | 20221212192239750 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192239750 DLGLOBAL DEBUG validating counter group 0x7f3333cecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192239750 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192239750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192239750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192239750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192239752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192239752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192239753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192239753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:22:40.738799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18417): Terminating (SIGTERM) 19:22:40.781238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18420): Terminating (SIGTERM) 19:22:40.823586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18423): Terminating (SIGTERM) 19:22:40.866370 --- ParallelTerminationStrategy: PID 18417 died... 19:22:40.886827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18417): Terminated: ok {rc=0} 19:22:40.934721 --- ParallelTerminationStrategy: PID 18420 died... 19:22:40.954508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18420): Terminated: ok {rc=0} 19:22:41.001805 --- ParallelTerminationStrategy: PID 18423 died... 19:22:41.021900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18423): Terminated: ok {rc=0} 19:22:41.112043 bus /sierra_9: Setting Powered False 19:22:42.213549 bus /sierra_9: Setting Powered False 19:22:43.332005 bus /sierra_8: Setting Powered False 19:22:44.428341 bus /sierra_8: Setting Powered False 19:22:45.545410 bus /sierra_3: Setting Powered False 19:22:46.655905 bus /sierra_3: Setting Powered False 19:22:47.788283 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:oc2g --------------------------------------------------------------------- 19:22:49.046324 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:49.050461 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 19:22:49.070792 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 19:22:49.109109 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 19:22:49.195077 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 19:22:49.215559 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 19:22:49.253855 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 19:22:49.841345 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 19:22:49.891054 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:49.901583 tst gprs:oc2g: Using 1 x bts (candidates: 1) 19:22:49.935785 tst cs_paging_gprs_active.py: using LAC 30960 19:22:50.066112 tst cs_paging_gprs_active.py: using RAC 105 19:22:50.196874 tst cs_paging_gprs_active.py: using CellId 30960 19:22:50.326059 tst cs_paging_gprs_active.py: using BVCI 30961 19:22:50.446054 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.457117 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.467941 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.479107 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.490118 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.501157 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.512559 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.523818 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:22:50.535032 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:22:50.651760 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:22:50.772318 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:22:50.995564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:51.327654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18430): Launched 19:22:51.616711 run iperf3-srv_10.42.42.10(pid=18431): Launched 19:22:51.740061 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:22:51.963209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:52.295173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18432): Launched 19:22:52.584044 run iperf3-srv_10.42.42.10(pid=18433): Launched 19:22:52.707628 tst cs_paging_gprs_active.py:38: start network... 19:22:52.929268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:53.438352 run create_hlr_db(pid=18434): Launched 19:22:53.563529 bus /sierra_2: Setting Powered False 19:22:54.628603 run create_hlr_db(pid=18434): Terminated: ok {rc=0} 19:22:55.087170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18436): Launched 19:22:55.417451 run osmo-hlr_10.42.42.2(pid=18437): Launched 19:22:55.543695 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:56.113820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18439): Launched 19:22:56.442721 run osmo-stp_10.42.42.5(pid=18440): Launched 19:22:56.568423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:22:57.136412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18442): Launched 19:22:57.262432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:22:57.542245 run patchelf(pid=18443): Launched 19:22:57.725583 run osmo-stp_10.42.42.5(pid=18440): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18440)] 19:22:57.865190 run osmo-stp_10.42.42.5(pid=18440): stdout: | (launched: 2022-12-12_19:22:56.382135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:58.006530 run osmo-stp_10.42.42.5(pid=18440): stderr: | 20221212192256574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192256574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192256574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192256574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192256575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192256575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192256575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:58.148563 run osmo-stp_10.42.42.5(pid=18440): stdout: | (launched: 2022-12-12_19:22:56.382135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:58.283410 run osmo-stp_10.42.42.5(pid=18440): stderr: | 20221212192256574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192256574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192256574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192256574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192256575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192256575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192256575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:58.443601 run patchelf(pid=18443): Terminating (SIGINT) 19:22:58.629322 run patchelf(pid=18443): Terminated: ok {rc=0} 19:22:58.762736 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18440): Process ended prematurely: osmo-stp_10.42.42.5(pid=18440) [trial-2381↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18440)] [trial-2381↪gprs:oc2g↪cs_paging_gprs_active.py:38] 19:22:58.772832 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:22:58.802544 run osmo-hlr_10.42.42.2(pid=18437): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18437)] 19:22:58.853346 run osmo-hlr_10.42.42.2(pid=18437): stdout: | (launched: 2022-12-12_19:22:55.356499) 19:22:58.906094 run osmo-hlr_10.42.42.2(pid=18437): stderr: | 20221212192255554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192255554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192255554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192255554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192255554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192255554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192255567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192255577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192255577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192255578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:58.959354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18430): Terminating (SIGTERM) 19:22:59.001641 run iperf3-srv_10.42.42.10(pid=18431): Terminating (SIGTERM) 19:22:59.043857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18432): Terminating (SIGTERM) 19:22:59.086763 run iperf3-srv_10.42.42.10(pid=18433): Terminating (SIGTERM) 19:22:59.128770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18436): Terminating (SIGTERM) 19:22:59.171138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18439): Terminating (SIGTERM) 19:22:59.213533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18442): Terminating (SIGTERM) 19:22:59.256010 --- ParallelTerminationStrategy: PID 18430 died... 19:22:59.276031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18430): Terminated: ok {rc=0} 19:22:59.323666 --- ParallelTerminationStrategy: PID 18431 died... 19:22:59.343120 run iperf3-srv_10.42.42.10(pid=18431): Terminated {rc=256} 19:22:59.389894 --- ParallelTerminationStrategy: PID 18432 died... 19:22:59.409550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18432): Terminated: ok {rc=0} 19:22:59.456390 --- ParallelTerminationStrategy: PID 18433 died... 19:22:59.476167 run iperf3-srv_10.42.42.10(pid=18433): Terminated {rc=256} 19:22:59.523439 --- ParallelTerminationStrategy: PID 18436 died... 19:22:59.543108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18436): Terminated: ok {rc=0} 19:22:59.590101 --- ParallelTerminationStrategy: PID 18439 died... 19:22:59.609868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18439): Terminated: ok {rc=0} 19:22:59.656808 --- ParallelTerminationStrategy: PID 18442 died... 19:22:59.677032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18442): Terminated: ok {rc=0} 19:22:59.766412 bus /gobi_0: Setting Powered False 19:23:00.871500 bus /gobi_0: Setting Powered False 19:23:01.997831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g iperf3.py ---------------------------------------------- 19:23:03.152175 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.163811 tst gprs:oc2g: Using 1 x bts (candidates: 1) 19:23:03.200142 tst iperf3.py: using LAC 30961 19:23:03.328634 tst iperf3.py: using RAC 106 19:23:03.456735 tst iperf3.py: using CellId 30961 19:23:03.587730 tst iperf3.py: using BVCI 30962 19:23:03.709191 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.720087 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.731280 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.743008 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.754542 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.766187 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.777963 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.789622 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:03.801470 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:23:03.923594 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:23:04.132158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:23:04.441750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18444): Launched 19:23:04.711532 run iperf3-srv_10.42.42.10(pid=18445): Launched 19:23:04.826938 tst iperf3.py:8: start network... 19:23:05.032545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:05.509944 run create_hlr_db(pid=18446): Launched 19:23:05.637160 bus /gobi_6: Setting Powered False 19:23:06.698866 run create_hlr_db(pid=18446): Terminated: ok {rc=0} 19:23:07.127600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18448): Launched 19:23:07.436430 run osmo-hlr_10.42.42.2(pid=18449): Launched 19:23:07.554022 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:08.086425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18451): Launched 19:23:08.394698 run osmo-stp_10.42.42.5(pid=18452): Launched 19:23:08.510882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:09.042632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18454): Launched 19:23:09.160394 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:09.420010 run patchelf(pid=18455): Launched 19:23:09.591584 run osmo-stp_10.42.42.5(pid=18452): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18452)] 19:23:09.721898 run osmo-stp_10.42.42.5(pid=18452): stdout: | (launched: 2022-12-12_19:23:08.337081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:09.853914 run osmo-stp_10.42.42.5(pid=18452): stderr: | 20221212192308509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192308509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192308510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192308510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192308510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192308511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192308511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:09.986255 run osmo-stp_10.42.42.5(pid=18452): stdout: | (launched: 2022-12-12_19:23:08.337081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:10.112602 run osmo-stp_10.42.42.5(pid=18452): stderr: | 20221212192308509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192308509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192308510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192308510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192308510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192308511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192308511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:10.261628 run patchelf(pid=18455): Terminating (SIGINT) 19:23:10.433624 run patchelf(pid=18455): Terminated: ok {rc=0} 19:23:10.557978 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18452): Process ended prematurely: osmo-stp_10.42.42.5(pid=18452) [trial-2381↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18452)] [trial-2381↪gprs:oc2g↪iperf3.py:8] 19:23:10.567418 tst iperf3.py:8: Test FAILED (7.5 sec) 19:23:10.595441 run osmo-hlr_10.42.42.2(pid=18449): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18449)] 19:23:10.643434 run osmo-hlr_10.42.42.2(pid=18449): stdout: | (launched: 2022-12-12_19:23:07.379041) 19:23:10.693172 run osmo-hlr_10.42.42.2(pid=18449): stderr: | 20221212192307556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192307556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192307556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192307556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192307556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192307556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192307569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192307578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192307578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192307578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:10.743648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18444): Terminating (SIGTERM) 19:23:10.783507 run iperf3-srv_10.42.42.10(pid=18445): Terminating (SIGTERM) 19:23:10.823294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18448): Terminating (SIGTERM) 19:23:10.863296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18451): Terminating (SIGTERM) 19:23:10.902986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18454): Terminating (SIGTERM) 19:23:10.942904 --- ParallelTerminationStrategy: PID 18444 died... 19:23:10.962369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18444): Terminated: ok {rc=0} 19:23:11.006785 --- ParallelTerminationStrategy: PID 18445 died... 19:23:11.025647 run iperf3-srv_10.42.42.10(pid=18445): Terminated {rc=256} 19:23:11.069871 --- ParallelTerminationStrategy: PID 18448 died... 19:23:11.088798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18448): Terminated: ok {rc=0} 19:23:11.133321 --- ParallelTerminationStrategy: PID 18451 died... 19:23:11.152179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18451): Terminated: ok {rc=0} 19:23:11.196429 --- ParallelTerminationStrategy: PID 18454 died... 19:23:11.215260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18454): Terminated: ok {rc=0} 19:23:11.300729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g iperf3m4.py ---------------------------------------------- 19:23:12.450232 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:12.461655 tst gprs:oc2g: Using 1 x bts (candidates: 1) 19:23:12.497596 tst iperf3m4.py: using LAC 30962 19:23:12.619861 tst iperf3m4.py: using RAC 107 19:23:12.750465 tst iperf3m4.py: using CellId 30962 19:23:12.881158 tst iperf3m4.py: using BVCI 30963 19:23:12.994067 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.004591 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.015373 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.026535 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.037672 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.048605 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.059727 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.070623 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:13.081737 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:23:13.197551 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:23:13.316256 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:23:13.436449 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:23:13.553065 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:23:13.759926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:23:14.070700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18456): Launched 19:23:14.340488 run iperf3-srv_10.42.42.10(pid=18457): Launched 19:23:14.456004 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:23:14.661261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:23:14.992090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18458): Launched 19:23:15.281203 run iperf3-srv_10.42.42.10(pid=18459): Launched 19:23:15.405567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:23:15.628850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:23:15.962972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18460): Launched 19:23:16.251522 run iperf3-srv_10.42.42.10(pid=18461): Launched 19:23:16.383871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:23:16.594199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:23:16.910118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18462): Launched 19:23:17.185553 run iperf3-srv_10.42.42.10(pid=18463): Launched 19:23:17.314680 tst iperf3m4.py:8: start network... 19:23:17.518991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:17.998536 run create_hlr_db(pid=18464): Launched 19:23:18.124263 bus /gobi_6: Setting Powered False 19:23:19.185172 run create_hlr_db(pid=18464): Terminated: ok {rc=0} 19:23:19.636665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18466): Launched 19:23:19.967013 run osmo-hlr_10.42.42.2(pid=18467): Launched 19:23:20.092900 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:20.659190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18469): Launched 19:23:20.989088 run osmo-stp_10.42.42.5(pid=18470): Launched 19:23:21.114697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:21.685474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18472): Launched 19:23:21.811755 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:22.091686 run patchelf(pid=18473): Launched 19:23:22.275684 run osmo-stp_10.42.42.5(pid=18470): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18470)] 19:23:22.415660 run osmo-stp_10.42.42.5(pid=18470): stdout: | (launched: 2022-12-12_19:23:20.927913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:22.557493 run osmo-stp_10.42.42.5(pid=18470): stderr: | 20221212192321120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192321120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192321120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192321121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192321121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192321121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192321121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:22.699531 run osmo-stp_10.42.42.5(pid=18470): stdout: | (launched: 2022-12-12_19:23:20.927913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:22.834770 run osmo-stp_10.42.42.5(pid=18470): stderr: | 20221212192321120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192321120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192321120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192321121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192321121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192321121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192321121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:22.995115 run patchelf(pid=18473): Terminating (SIGINT) 19:23:23.179719 run patchelf(pid=18473): Terminated: ok {rc=0} 19:23:23.313129 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18470): Process ended prematurely: osmo-stp_10.42.42.5(pid=18470) [trial-2381↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18470)] [trial-2381↪gprs:oc2g↪iperf3m4.py:8] 19:23:23.323576 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:23:23.353584 run osmo-hlr_10.42.42.2(pid=18467): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18467)] 19:23:23.404916 run osmo-hlr_10.42.42.2(pid=18467): stdout: | (launched: 2022-12-12_19:23:19.905781) 19:23:23.457837 run osmo-hlr_10.42.42.2(pid=18467): stderr: | 20221212192320105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192320105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192320105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192320105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192320105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192320105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192320119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192320127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192320127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192320127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:23.511299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18456): Terminating (SIGTERM) 19:23:23.554659 run iperf3-srv_10.42.42.10(pid=18457): Terminating (SIGTERM) 19:23:23.597492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18458): Terminating (SIGTERM) 19:23:23.640397 run iperf3-srv_10.42.42.10(pid=18459): Terminating (SIGTERM) 19:23:23.683011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18460): Terminating (SIGTERM) 19:23:23.725834 run iperf3-srv_10.42.42.10(pid=18461): Terminating (SIGTERM) 19:23:23.768387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18462): Terminating (SIGTERM) 19:23:23.811177 run iperf3-srv_10.42.42.10(pid=18463): Terminating (SIGTERM) 19:23:23.853748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18466): Terminating (SIGTERM) 19:23:23.896430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18469): Terminating (SIGTERM) 19:23:23.939327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18472): Terminating (SIGTERM) 19:23:23.982203 --- ParallelTerminationStrategy: PID 18456 died... 19:23:24.002701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18456): Terminated: ok {rc=0} 19:23:24.050754 --- ParallelTerminationStrategy: PID 18457 died... 19:23:24.070913 run iperf3-srv_10.42.42.10(pid=18457): Terminated {rc=256} 19:23:24.118608 --- ParallelTerminationStrategy: PID 18458 died... 19:23:24.138699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18458): Terminated: ok {rc=0} 19:23:24.186478 --- ParallelTerminationStrategy: PID 18459 died... 19:23:24.206673 run iperf3-srv_10.42.42.10(pid=18459): Terminated {rc=256} 19:23:24.254314 --- ParallelTerminationStrategy: PID 18460 died... 19:23:24.274388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18460): Terminated: ok {rc=0} 19:23:24.322162 --- ParallelTerminationStrategy: PID 18461 died... 19:23:24.342370 run iperf3-srv_10.42.42.10(pid=18461): Terminated {rc=256} 19:23:24.390186 --- ParallelTerminationStrategy: PID 18462 died... 19:23:24.410286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18462): Terminated: ok {rc=0} 19:23:24.457827 --- ParallelTerminationStrategy: PID 18463 died... 19:23:24.478050 run iperf3-srv_10.42.42.10(pid=18463): Terminated {rc=256} 19:23:24.526065 --- ParallelTerminationStrategy: PID 18466 died... 19:23:24.546227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18466): Terminated: ok {rc=0} 19:23:24.594065 --- ParallelTerminationStrategy: PID 18469 died... 19:23:24.614223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18469): Terminated: ok {rc=0} 19:23:24.661935 --- ParallelTerminationStrategy: PID 18472 died... 19:23:24.682108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18472): Terminated: ok {rc=0} 19:23:24.771943 bus /gobi_4: Setting Powered False 19:23:25.872655 bus /gobi_4: Setting Powered False 19:23:26.993239 bus /gobi_1: Setting Powered False 19:23:28.093984 bus /gobi_1: Setting Powered False 19:23:29.211055 bus /gobi_0: Setting Powered False 19:23:30.310662 bus /gobi_0: Setting Powered False 19:23:31.433162 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g ping.py ---------------------------------------------- 19:23:32.551949 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:32.563903 tst gprs:oc2g: Using 1 x bts (candidates: 1) 19:23:32.602177 tst ping.py: using LAC 30963 19:23:32.730488 tst ping.py: using RAC 108 19:23:32.858652 tst ping.py: using CellId 30963 19:23:32.985395 tst ping.py: using BVCI 30964 19:23:33.105137 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:33.116461 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:33.127561 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:33.139073 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:33.150407 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:33.161888 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:33.173418 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:33.184617 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:23:33.301126 tst ping.py:19: start network... 19:23:33.504377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:33.972703 run create_hlr_db(pid=18474): Launched 19:23:34.097326 bus /gobi_6: Setting Powered False 19:23:35.157763 run create_hlr_db(pid=18474): Terminated: ok {rc=0} 19:23:35.602947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18476): Launched 19:23:35.928240 run osmo-hlr_10.42.42.2(pid=18477): Launched 19:23:36.051434 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:36.618133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18479): Launched 19:23:36.943416 run osmo-stp_10.42.42.5(pid=18480): Launched 19:23:37.067021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:37.630144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18482): Launched 19:23:37.755763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:38.030842 run patchelf(pid=18483): Launched 19:23:38.211133 run osmo-stp_10.42.42.5(pid=18480): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18480)] 19:23:38.349298 run osmo-stp_10.42.42.5(pid=18480): stdout: | (launched: 2022-12-12_19:23:36.883141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:38.488557 run osmo-stp_10.42.42.5(pid=18480): stderr: | 20221212192337074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192337074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192337074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192337075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192337075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192337075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192337075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:38.628179 run osmo-stp_10.42.42.5(pid=18480): stdout: | (launched: 2022-12-12_19:23:36.883141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:38.761546 run osmo-stp_10.42.42.5(pid=18480): stderr: | 20221212192337074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192337074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192337074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192337075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192337075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192337075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192337075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:38.919607 run patchelf(pid=18483): Terminating (SIGINT) 19:23:39.101033 run patchelf(pid=18483): Terminated: ok {rc=0} 19:23:39.231344 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18480): Process ended prematurely: osmo-stp_10.42.42.5(pid=18480) [trial-2381↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18480)] [trial-2381↪gprs:oc2g↪ping.py:22] 19:23:39.240920 tst ping.py:22: Test FAILED (6.7 sec) 19:23:39.270476 run osmo-hlr_10.42.42.2(pid=18477): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18477)] 19:23:39.322043 run osmo-hlr_10.42.42.2(pid=18477): stdout: | (launched: 2022-12-12_19:23:35.868139) 19:23:39.375159 run osmo-hlr_10.42.42.2(pid=18477): stderr: | 20221212192336067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192336067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192336067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192336067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192336067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192336067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192336081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192336090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192336091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192336091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:39.428482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18476): Terminating (SIGTERM) 19:23:39.472017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18479): Terminating (SIGTERM) 19:23:39.515068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18482): Terminating (SIGTERM) 19:23:39.558672 --- ParallelTerminationStrategy: PID 18476 died... 19:23:39.579215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18476): Terminated: ok {rc=0} 19:23:39.627718 --- ParallelTerminationStrategy: PID 18479 died... 19:23:39.647895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18479): Terminated: ok {rc=0} 19:23:39.696030 --- ParallelTerminationStrategy: PID 18482 died... 19:23:39.716173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18482): Terminated: ok {rc=0} 19:23:39.805512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 19:23:40.894675 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:40.906180 tst gprs:oc2g: Using 1 x bts (candidates: 1) 19:23:40.946188 tst ping_idle_ping.py: using LAC 30964 19:23:41.074224 tst ping_idle_ping.py: using RAC 109 19:23:41.201117 tst ping_idle_ping.py: using CellId 30964 19:23:41.327600 tst ping_idle_ping.py: using BVCI 30965 19:23:41.438989 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:41.450051 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:41.460634 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:41.471291 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:41.481891 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:41.492120 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:41.502802 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 19:23:41.513327 tst gprs:oc2g: Using 1 x modem (candidates: 4) 19:23:41.632851 tst ping_idle_ping.py:24: start network... 19:23:41.852327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:42.358985 run create_hlr_db(pid=18484): Launched 19:23:42.483412 bus /gobi_6: Setting Powered False 19:23:43.547838 run create_hlr_db(pid=18484): Terminated: ok {rc=0} 19:23:44.001650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18486): Launched 19:23:44.327086 run osmo-hlr_10.42.42.2(pid=18487): Launched 19:23:44.451449 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:45.013295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18489): Launched 19:23:45.339065 run osmo-stp_10.42.42.5(pid=18490): Launched 19:23:45.462419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:46.035532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18492): Launched 19:23:46.218567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:46.551383 run patchelf(pid=18521): Launched 19:23:46.775387 run osmo-stp_10.42.42.5(pid=18490): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18490)] 19:23:46.909493 run osmo-stp_10.42.42.5(pid=18490): stdout: | (launched: 2022-12-12_19:23:45.278660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:47.045251 run osmo-stp_10.42.42.5(pid=18490): stderr: | 20221212192345471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192345471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192345472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192345472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192345473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192345473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192345473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:47.203151 run osmo-stp_10.42.42.5(pid=18490): stdout: | (launched: 2022-12-12_19:23:45.278660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:47.340643 run osmo-stp_10.42.42.5(pid=18490): stderr: | 20221212192345471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192345471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192345472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192345472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192345473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192345473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192345473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:47.494800 run patchelf(pid=18521): Terminating (SIGINT) 19:23:47.683204 run patchelf(pid=18521): Terminated: ok {rc=0} 19:23:47.830023 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18490): Process ended prematurely: osmo-stp_10.42.42.5(pid=18490) [trial-2381↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18490)] [trial-2381↪gprs:oc2g↪ping_idle_ping.py:27] 19:23:47.840319 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 19:23:47.875502 run osmo-hlr_10.42.42.2(pid=18487): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18487)] 19:23:47.935666 run osmo-hlr_10.42.42.2(pid=18487): stdout: | (launched: 2022-12-12_19:23:44.266694) 19:23:47.990240 run osmo-hlr_10.42.42.2(pid=18487): stderr: | 20221212192344466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192344466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192344466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192344466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192344466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192344466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192344479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192344487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192344487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192344487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:48.045276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18486): Terminating (SIGTERM) 19:23:48.095316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18489): Terminating (SIGTERM) 19:23:48.140338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18492): Terminating (SIGTERM) 19:23:48.192704 --- ParallelTerminationStrategy: PID 18486 died... 19:23:48.213243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18486): Terminated: ok {rc=0} 19:23:48.265435 --- ParallelTerminationStrategy: PID 18489 died... 19:23:48.285222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18489): Terminated: ok {rc=0} 19:23:48.340518 --- ParallelTerminationStrategy: PID 18492 died... 19:23:48.365951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18492): Terminated: ok {rc=0} 19:23:48.478356 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 19:23:49.781819 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:49.788075 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:23:49.809871 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:23:49.856569 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:23:49.946782 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:23:49.969271 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:23:50.012219 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:23:50.603256 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:23:50.660281 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:50.672836 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:23:50.713209 tst cs_paging_gprs_active.py: using LAC 30965 19:23:50.850367 tst cs_paging_gprs_active.py: using RAC 110 19:23:50.978461 tst cs_paging_gprs_active.py: using CellId 30965 19:23:51.107195 tst cs_paging_gprs_active.py: using BVCI 30966 19:23:51.228108 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.240398 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.252512 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.265732 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.278208 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.290969 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.304434 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.318338 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:23:51.330712 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:23:51.454878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:23:51.579270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:23:51.803890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:23:52.139596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18770): Launched 19:23:52.438833 run iperf3-srv_10.42.42.10(pid=18771): Launched 19:23:52.577460 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:23:52.803114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:23:53.135528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18772): Launched 19:23:53.433934 run iperf3-srv_10.42.42.10(pid=18773): Launched 19:23:53.563231 tst cs_paging_gprs_active.py:38: start network... 19:23:53.767957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:54.245688 run create_hlr_db(pid=18774): Launched 19:23:54.394211 bus /gobi_6: Setting Powered False 19:23:55.458068 run create_hlr_db(pid=18774): Terminated: ok {rc=0} 19:23:55.899725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18776): Launched 19:23:56.225811 run osmo-hlr_10.42.42.2(pid=18777): Launched 19:23:56.470401 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:57.174870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18779): Launched 19:23:57.503297 run osmo-stp_10.42.42.5(pid=18780): Launched 19:23:57.750262 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:58.428504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18782): Launched 19:23:58.563608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:58.831685 run patchelf(pid=18783): Launched 19:23:59.019519 run osmo-stp_10.42.42.5(pid=18780): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18780)] 19:23:59.156294 run osmo-stp_10.42.42.5(pid=18780): stdout: | (launched: 2022-12-12_19:23:57.444567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:59.291977 run osmo-stp_10.42.42.5(pid=18780): stderr: | 20221212192357772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192357772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192357772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192357773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192357773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192357773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192357774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:59.427913 run osmo-stp_10.42.42.5(pid=18780): stdout: | (launched: 2022-12-12_19:23:57.444567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:59.558585 run osmo-stp_10.42.42.5(pid=18780): stderr: | 20221212192357772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192357772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192357772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192357773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192357773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192357773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192357774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:59.711111 run patchelf(pid=18783): Terminating (SIGINT) 19:23:59.888660 run patchelf(pid=18783): Terminated: ok {rc=0} 19:24:00.016513 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18780): Process ended prematurely: osmo-stp_10.42.42.5(pid=18780) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18780)] [trial-2381↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:24:00.028490 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 19:24:00.057814 run osmo-hlr_10.42.42.2(pid=18777): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18777)] 19:24:00.108385 run osmo-hlr_10.42.42.2(pid=18777): stdout: | (launched: 2022-12-12_19:23:56.167270) 19:24:00.160695 run osmo-hlr_10.42.42.2(pid=18777): stderr: | 20221212192356501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192356501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192356502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192356502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192356502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192356502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192356527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192356540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192356540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192356540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:00.213732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18770): Terminating (SIGTERM) 19:24:00.257702 run iperf3-srv_10.42.42.10(pid=18771): Terminating (SIGTERM) 19:24:00.303250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18772): Terminating (SIGTERM) 19:24:00.347214 run iperf3-srv_10.42.42.10(pid=18773): Terminating (SIGTERM) 19:24:00.392191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18776): Terminating (SIGTERM) 19:24:00.435928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18779): Terminating (SIGTERM) 19:24:00.480942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18782): Terminating (SIGTERM) 19:24:00.526292 --- ParallelTerminationStrategy: PID 18770 died... 19:24:00.546480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18770): Terminated: ok {rc=0} 19:24:00.594796 --- ParallelTerminationStrategy: PID 18771 died... 19:24:00.614493 run iperf3-srv_10.42.42.10(pid=18771): Terminated {rc=256} 19:24:00.661556 --- ParallelTerminationStrategy: PID 18772 died... 19:24:00.681676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18772): Terminated: ok {rc=0} 19:24:00.727725 --- ParallelTerminationStrategy: PID 18773 died... 19:24:00.747600 run iperf3-srv_10.42.42.10(pid=18773): Terminated {rc=256} 19:24:00.794311 --- ParallelTerminationStrategy: PID 18776 died... 19:24:00.814447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18776): Terminated: ok {rc=0} 19:24:00.861963 --- ParallelTerminationStrategy: PID 18779 died... 19:24:00.882161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18779): Terminated: ok {rc=0} 19:24:00.929130 --- ParallelTerminationStrategy: PID 18782 died... 19:24:00.950009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18782): Terminated: ok {rc=0} 19:24:01.057842 bus /gobi_0: Setting Powered False 19:24:02.209365 bus /gobi_0: Setting Powered False 19:24:03.354581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:24:04.507004 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:04.519226 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:24:04.558203 tst iperf3.py: using LAC 30966 19:24:04.686599 tst iperf3.py: using RAC 111 19:24:04.810523 tst iperf3.py: using CellId 30966 19:24:04.933482 tst iperf3.py: using BVCI 30967 19:24:05.047905 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.060188 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.072129 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.084543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.096611 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.108447 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.119941 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.132141 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:05.144392 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:24:05.267840 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:24:05.481466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:24:05.802162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18784): Launched 19:24:06.093203 run iperf3-srv_10.42.42.10(pid=18785): Launched 19:24:06.225801 tst iperf3.py:8: start network... 19:24:06.437865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:06.929253 run create_hlr_db(pid=18786): Launched 19:24:07.094979 bus /gobi_6: Setting Powered False 19:24:08.157326 run create_hlr_db(pid=18786): Terminated: ok {rc=0} 19:24:08.602883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18788): Launched 19:24:08.933520 run osmo-hlr_10.42.42.2(pid=18789): Launched 19:24:09.068931 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:09.631262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18791): Launched 19:24:09.958543 run osmo-stp_10.42.42.5(pid=18792): Launched 19:24:10.083390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:24:10.645779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18794): Launched 19:24:10.769566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:24:11.043456 run patchelf(pid=18795): Launched 19:24:11.225058 run osmo-stp_10.42.42.5(pid=18792): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18792)] 19:24:11.362891 run osmo-stp_10.42.42.5(pid=18792): stdout: | (launched: 2022-12-12_19:24:09.898456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:11.503023 run osmo-stp_10.42.42.5(pid=18792): stderr: | 20221212192410091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192410091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192410092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192410092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192410092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192410092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192410093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:11.643687 run osmo-stp_10.42.42.5(pid=18792): stdout: | (launched: 2022-12-12_19:24:09.898456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:11.776894 run osmo-stp_10.42.42.5(pid=18792): stderr: | 20221212192410091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192410091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192410092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192410092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192410092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192410092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192410093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:11.934837 run patchelf(pid=18795): Terminating (SIGINT) 19:24:12.115877 run patchelf(pid=18795): Terminated: ok {rc=0} 19:24:12.246750 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18792): Process ended prematurely: osmo-stp_10.42.42.5(pid=18792) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18792)] [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 19:24:12.257115 tst iperf3.py:8: Test FAILED (7.8 sec) 19:24:12.285858 run osmo-hlr_10.42.42.2(pid=18789): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18789)] 19:24:12.336820 run osmo-hlr_10.42.42.2(pid=18789): stdout: | (launched: 2022-12-12_19:24:08.874101) 19:24:12.389198 run osmo-hlr_10.42.42.2(pid=18789): stderr: | 20221212192409085 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192409085 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192409085 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192409085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192409085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192409085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192409098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192409106 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192409106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192409106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:12.442055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18784): Terminating (SIGTERM) 19:24:12.484415 run iperf3-srv_10.42.42.10(pid=18785): Terminating (SIGTERM) 19:24:12.526754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18788): Terminating (SIGTERM) 19:24:12.569457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18791): Terminating (SIGTERM) 19:24:12.611942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18794): Terminating (SIGTERM) 19:24:12.654536 --- ParallelTerminationStrategy: PID 18784 died... 19:24:12.674629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18784): Terminated: ok {rc=0} 19:24:12.722193 --- ParallelTerminationStrategy: PID 18785 died... 19:24:12.741902 run iperf3-srv_10.42.42.10(pid=18785): Terminated {rc=256} 19:24:12.789056 --- ParallelTerminationStrategy: PID 18788 died... 19:24:12.808719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18788): Terminated: ok {rc=0} 19:24:12.856115 --- ParallelTerminationStrategy: PID 18791 died... 19:24:12.875973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18791): Terminated: ok {rc=0} 19:24:12.923289 --- ParallelTerminationStrategy: PID 18794 died... 19:24:12.943010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18794): Terminated: ok {rc=0} 19:24:13.032074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:24:14.181125 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.192703 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:24:14.231546 tst iperf3m4.py: using LAC 30967 19:24:14.352389 tst iperf3m4.py: using RAC 112 19:24:14.472738 tst iperf3m4.py: using CellId 30967 19:24:14.593549 tst iperf3m4.py: using BVCI 30968 19:24:14.712721 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.724198 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.735397 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.746896 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.758334 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.770185 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.782074 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.793851 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:14.805412 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:24:14.925302 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:24:15.045072 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:24:15.162660 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:24:15.282080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:24:15.500421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:24:15.828879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18796): Launched 19:24:16.165329 run iperf3-srv_10.42.42.10(pid=18797): Launched 19:24:16.350306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:24:16.607404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:24:16.922930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18798): Launched 19:24:17.226768 run iperf3-srv_10.42.42.10(pid=18799): Launched 19:24:17.357395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:24:17.559964 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:24:17.865539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18800): Launched 19:24:18.129483 run iperf3-srv_10.42.42.10(pid=18801): Launched 19:24:18.242733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:24:18.443736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:24:18.748327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18802): Launched 19:24:19.014102 run iperf3-srv_10.42.42.10(pid=18803): Launched 19:24:19.129152 tst iperf3m4.py:8: start network... 19:24:19.330605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:19.801613 run create_hlr_db(pid=18804): Launched 19:24:19.929821 bus /gobi_6: Setting Powered False 19:24:20.990416 run create_hlr_db(pid=18804): Terminated: ok {rc=0} 19:24:21.414062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Launched 19:24:21.718388 run osmo-hlr_10.42.42.2(pid=18815): Launched 19:24:21.835431 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:22.358096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Launched 19:24:22.661909 run osmo-stp_10.42.42.5(pid=18818): Launched 19:24:22.777699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:24:23.301727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18820): Launched 19:24:23.418974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:24:23.676880 run patchelf(pid=18821): Launched 19:24:23.846366 run osmo-stp_10.42.42.5(pid=18818): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] 19:24:23.974850 run osmo-stp_10.42.42.5(pid=18818): stdout: | (launched: 2022-12-12_19:24:22.605219) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:24.105701 run osmo-stp_10.42.42.5(pid=18818): stderr: | 20221212192422776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192422777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192422777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192422777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192422778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192422778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192422778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:24.236383 run osmo-stp_10.42.42.5(pid=18818): stdout: | (launched: 2022-12-12_19:24:22.605219) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:24.360564 run osmo-stp_10.42.42.5(pid=18818): stderr: | 20221212192422776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192422777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192422777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192422777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192422778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192422778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192422778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:24.507704 run patchelf(pid=18821): Terminating (SIGINT) 19:24:24.678050 run patchelf(pid=18821): Terminated: ok {rc=0} 19:24:24.802172 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18818): Process ended prematurely: osmo-stp_10.42.42.5(pid=18818) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 19:24:24.811702 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:24:24.839406 run osmo-hlr_10.42.42.2(pid=18815): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18815)] 19:24:24.888533 run osmo-hlr_10.42.42.2(pid=18815): stdout: | (launched: 2022-12-12_19:24:21.661345) 19:24:24.938895 run osmo-hlr_10.42.42.2(pid=18815): stderr: | 20221212192421837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192421837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192421837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192421837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192421837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192421837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192421850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192421859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192421859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192421859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:24.989529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18796): Terminating (SIGTERM) 19:24:25.029870 run iperf3-srv_10.42.42.10(pid=18797): Terminating (SIGTERM) 19:24:25.070109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18798): Terminating (SIGTERM) 19:24:25.110257 run iperf3-srv_10.42.42.10(pid=18799): Terminating (SIGTERM) 19:24:25.150251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18800): Terminating (SIGTERM) 19:24:25.190383 run iperf3-srv_10.42.42.10(pid=18801): Terminating (SIGTERM) 19:24:25.230527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18802): Terminating (SIGTERM) 19:24:25.270604 run iperf3-srv_10.42.42.10(pid=18803): Terminating (SIGTERM) 19:24:25.310781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Terminating (SIGTERM) 19:24:25.350898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Terminating (SIGTERM) 19:24:25.391124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18820): Terminating (SIGTERM) 19:24:25.431568 --- ParallelTerminationStrategy: PID 18796 died... 19:24:25.450941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18796): Terminated: ok {rc=0} 19:24:25.495638 --- ParallelTerminationStrategy: PID 18797 died... 19:24:25.514537 run iperf3-srv_10.42.42.10(pid=18797): Terminated {rc=256} 19:24:25.559133 --- ParallelTerminationStrategy: PID 18798 died... 19:24:25.577980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18798): Terminated: ok {rc=0} 19:24:25.622380 --- ParallelTerminationStrategy: PID 18799 died... 19:24:25.641208 run iperf3-srv_10.42.42.10(pid=18799): Terminated {rc=256} 19:24:25.685580 --- ParallelTerminationStrategy: PID 18800 died... 19:24:25.704440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18800): Terminated: ok {rc=0} 19:24:25.748764 --- ParallelTerminationStrategy: PID 18801 died... 19:24:25.767598 run iperf3-srv_10.42.42.10(pid=18801): Terminated {rc=256} 19:24:25.812009 --- ParallelTerminationStrategy: PID 18802 died... 19:24:25.830785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18802): Terminated: ok {rc=0} 19:24:25.875047 --- ParallelTerminationStrategy: PID 18803 died... 19:24:25.893874 run iperf3-srv_10.42.42.10(pid=18803): Terminated {rc=256} 19:24:25.938660 --- ParallelTerminationStrategy: PID 18814 died... 19:24:25.957445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Terminated: ok {rc=0} 19:24:26.001738 --- ParallelTerminationStrategy: PID 18817 died... 19:24:26.020526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Terminated: ok {rc=0} 19:24:26.064790 --- ParallelTerminationStrategy: PID 18820 died... 19:24:26.083642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18820): Terminated: ok {rc=0} 19:24:26.170879 bus /gobi_4: Setting Powered False 19:24:27.273796 bus /gobi_4: Setting Powered False 19:24:28.388852 bus /gobi_1: Setting Powered False 19:24:29.487944 bus /gobi_1: Setting Powered False 19:24:30.606452 bus /gobi_0: Setting Powered False 19:24:31.706882 bus /gobi_0: Setting Powered False 19:24:32.828630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 19:24:33.932686 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:33.944698 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:24:33.983736 tst ping.py: using LAC 30968 19:24:34.109089 tst ping.py: using RAC 113 19:24:34.232687 tst ping.py: using CellId 30968 19:24:34.358352 tst ping.py: using BVCI 30969 19:24:34.474763 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:34.485668 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:34.496345 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:34.506989 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:34.517523 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:34.528458 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:34.539276 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:34.549975 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:24:34.666577 tst ping.py:19: start network... 19:24:34.867074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:35.328755 run create_hlr_db(pid=18822): Launched 19:24:35.449734 bus /gobi_6: Setting Powered False 19:24:36.508847 run create_hlr_db(pid=18822): Terminated: ok {rc=0} 19:24:36.926408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18824): Launched 19:24:37.224929 run osmo-hlr_10.42.42.2(pid=18825): Launched 19:24:37.338544 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:37.854310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18827): Launched 19:24:38.152632 run osmo-stp_10.42.42.5(pid=18828): Launched 19:24:38.267929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:24:38.782497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18830): Launched 19:24:38.897238 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:24:39.150256 run patchelf(pid=18831): Launched 19:24:39.316035 run osmo-stp_10.42.42.5(pid=18828): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18828)] 19:24:39.442829 run osmo-stp_10.42.42.5(pid=18828): stdout: | (launched: 2022-12-12_19:24:38.097100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:39.570939 run osmo-stp_10.42.42.5(pid=18828): stderr: | 20221212192438267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192438267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192438268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192438268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192438268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192438269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192438269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:39.698746 run osmo-stp_10.42.42.5(pid=18828): stdout: | (launched: 2022-12-12_19:24:38.097100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:39.820685 run osmo-stp_10.42.42.5(pid=18828): stderr: | 20221212192438267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192438267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192438268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192438268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192438268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192438269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192438269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:39.965311 run patchelf(pid=18831): Terminating (SIGINT) 19:24:40.132301 run patchelf(pid=18831): Terminated: ok {rc=0} 19:24:40.252059 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18828): Process ended prematurely: osmo-stp_10.42.42.5(pid=18828) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18828)] [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 19:24:40.261085 tst ping.py:22: Test FAILED (6.3 sec) 19:24:40.288119 run osmo-hlr_10.42.42.2(pid=18825): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18825)] 19:24:40.336568 run osmo-hlr_10.42.42.2(pid=18825): stdout: | (launched: 2022-12-12_19:24:37.169599) 19:24:40.386579 run osmo-hlr_10.42.42.2(pid=18825): stderr: | 20221212192437347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192437347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192437347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192437347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192437347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192437347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192437359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192437370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192437370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192437370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:40.437431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18824): Terminating (SIGTERM) 19:24:40.477913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18827): Terminating (SIGTERM) 19:24:40.518294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18830): Terminating (SIGTERM) 19:24:40.558835 --- ParallelTerminationStrategy: PID 18824 died... 19:24:40.578286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18824): Terminated: ok {rc=0} 19:24:40.622892 --- ParallelTerminationStrategy: PID 18827 died... 19:24:40.641824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18827): Terminated: ok {rc=0} 19:24:40.686144 --- ParallelTerminationStrategy: PID 18830 died... 19:24:40.704986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18830): Terminated: ok {rc=0} 19:24:40.789675 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:24:41.877911 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:41.890261 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:24:41.930460 tst ping_idle_ping.py: using LAC 30969 19:24:42.047660 tst ping_idle_ping.py: using RAC 114 19:24:42.165617 tst ping_idle_ping.py: using CellId 30969 19:24:42.284316 tst ping_idle_ping.py: using BVCI 30970 19:24:42.391848 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:42.402881 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:42.413774 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:42.424523 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:42.435095 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:42.445660 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:42.456322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:24:42.466970 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:24:42.586824 tst ping_idle_ping.py:24: start network... 19:24:42.802966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:43.302413 run create_hlr_db(pid=18832): Launched 19:24:43.426156 bus /gobi_6: Setting Powered False 19:24:44.490493 run create_hlr_db(pid=18832): Terminated: ok {rc=0} 19:24:44.939642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18834): Launched 19:24:45.262551 run osmo-hlr_10.42.42.2(pid=18835): Launched 19:24:45.386732 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:45.973723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18837): Launched 19:24:46.293146 run osmo-stp_10.42.42.5(pid=18838): Launched 19:24:46.534054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:24:47.209993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18840): Launched 19:24:47.334209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:24:47.607410 run patchelf(pid=18841): Launched 19:24:47.786993 run osmo-stp_10.42.42.5(pid=18838): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18838)] 19:24:47.922925 run osmo-stp_10.42.42.5(pid=18838): stdout: | (launched: 2022-12-12_19:24:46.235133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:48.060717 run osmo-stp_10.42.42.5(pid=18838): stderr: | 20221212192446579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192446589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192446589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192446590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192446590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192446590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192446590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:48.198916 run osmo-stp_10.42.42.5(pid=18838): stdout: | (launched: 2022-12-12_19:24:46.235133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:48.330747 run osmo-stp_10.42.42.5(pid=18838): stderr: | 20221212192446579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192446589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192446589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192446590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192446590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192446590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192446590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:48.486810 run patchelf(pid=18841): Terminating (SIGINT) 19:24:48.666161 run patchelf(pid=18841): Terminated: ok {rc=0} 19:24:48.795376 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18838): Process ended prematurely: osmo-stp_10.42.42.5(pid=18838) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18838)] [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 19:24:48.805153 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 19:24:48.833795 run osmo-hlr_10.42.42.2(pid=18835): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18835)] 19:24:48.885415 run osmo-hlr_10.42.42.2(pid=18835): stdout: | (launched: 2022-12-12_19:24:45.203277) 19:24:48.938796 run osmo-hlr_10.42.42.2(pid=18835): stderr: | 20221212192445400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192445400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192445400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192445400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192445400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192445400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192445413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192445421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192445421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192445422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:48.992609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18834): Terminating (SIGTERM) 19:24:49.035654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18837): Terminating (SIGTERM) 19:24:49.078558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18840): Terminating (SIGTERM) 19:24:49.121664 --- ParallelTerminationStrategy: PID 18834 died... 19:24:49.142121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18834): Terminated: ok {rc=0} 19:24:49.189807 --- ParallelTerminationStrategy: PID 18837 died... 19:24:49.209751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18837): Terminated: ok {rc=0} 19:24:49.257309 --- ParallelTerminationStrategy: PID 18840 died... 19:24:49.277193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18840): Terminated: ok {rc=0} 19:24:49.367294 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:24:50.663223 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:24:50.670260 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:24:50.691312 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:24:50.731570 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:24:50.822538 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:24:50.843085 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:24:50.881014 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:24:51.475532 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:24:51.529368 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:51.540772 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:24:51.599109 tst cs_paging_gprs_active.py: using LAC 30970 19:24:51.728220 tst cs_paging_gprs_active.py: using RAC 115 19:24:51.855654 tst cs_paging_gprs_active.py: using CellId 30970 19:24:51.975554 tst cs_paging_gprs_active.py: using BVCI 30971 19:24:52.087643 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.098891 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.109797 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.120427 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.130972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.141638 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.152323 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.163413 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:24:52.174216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:24:52.294054 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:24:52.412003 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:24:52.618870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:24:52.926946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18845): Launched 19:24:53.194298 run iperf3-srv_10.42.42.10(pid=18846): Launched 19:24:53.310593 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:24:53.514384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:24:53.821959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18847): Launched 19:24:54.089151 run iperf3-srv_10.42.42.10(pid=18848): Launched 19:24:54.202963 tst cs_paging_gprs_active.py:38: start network... 19:24:54.406875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:54.879758 run create_hlr_db(pid=18849): Launched 19:24:55.004867 bus /gobi_6: Setting Powered False 19:24:56.066375 run create_hlr_db(pid=18849): Terminated: ok {rc=0} 19:24:56.493859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18851): Launched 19:24:56.800623 run osmo-hlr_10.42.42.2(pid=18852): Launched 19:24:56.917395 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:57.447194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18854): Launched 19:24:57.754140 run osmo-stp_10.42.42.5(pid=18855): Launched 19:24:57.870308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:24:58.397271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18857): Launched 19:24:58.514024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:24:58.772905 run patchelf(pid=18858): Launched 19:24:58.943043 run osmo-stp_10.42.42.5(pid=18855): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18855)] 19:24:59.073851 run osmo-stp_10.42.42.5(pid=18855): stdout: | (launched: 2022-12-12_19:24:57.697081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:59.205225 run osmo-stp_10.42.42.5(pid=18855): stderr: | 20221212192457870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192457870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192457870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192457871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192457871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192457871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192457871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:59.336663 run osmo-stp_10.42.42.5(pid=18855): stdout: | (launched: 2022-12-12_19:24:57.697081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:59.461567 run osmo-stp_10.42.42.5(pid=18855): stderr: | 20221212192457870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192457870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192457870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192457871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192457871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192457871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192457871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:59.610153 run patchelf(pid=18858): Terminating (SIGINT) 19:24:59.781795 run patchelf(pid=18858): Terminated: ok {rc=0} 19:24:59.906144 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18855): Process ended prematurely: osmo-stp_10.42.42.5(pid=18855) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18855)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:24:59.915532 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 19:24:59.943022 run osmo-hlr_10.42.42.2(pid=18852): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18852)] 19:24:59.991576 run osmo-hlr_10.42.42.2(pid=18852): stdout: | (launched: 2022-12-12_19:24:56.743658) 19:25:00.041820 run osmo-hlr_10.42.42.2(pid=18852): stderr: | 20221212192456922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192456922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192456922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192456923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192456923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192456923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192456934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192456944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192456944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192456944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:00.092783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18845): Terminating (SIGTERM) 19:25:00.133213 run iperf3-srv_10.42.42.10(pid=18846): Terminating (SIGTERM) 19:25:00.173357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18847): Terminating (SIGTERM) 19:25:00.213588 run iperf3-srv_10.42.42.10(pid=18848): Terminating (SIGTERM) 19:25:00.253606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18851): Terminating (SIGTERM) 19:25:00.293968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18854): Terminating (SIGTERM) 19:25:00.334050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18857): Terminating (SIGTERM) 19:25:00.374289 --- ParallelTerminationStrategy: PID 18845 died... 19:25:00.393683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18845): Terminated: ok {rc=0} 19:25:00.438199 --- ParallelTerminationStrategy: PID 18846 died... 19:25:00.456772 run iperf3-srv_10.42.42.10(pid=18846): Terminated {rc=256} 19:25:00.501062 --- ParallelTerminationStrategy: PID 18847 died... 19:25:00.519661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18847): Terminated: ok {rc=0} 19:25:00.563956 --- ParallelTerminationStrategy: PID 18848 died... 19:25:00.582694 run iperf3-srv_10.42.42.10(pid=18848): Terminated {rc=256} 19:25:00.626945 --- ParallelTerminationStrategy: PID 18851 died... 19:25:00.645868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18851): Terminated: ok {rc=0} 19:25:00.690076 --- ParallelTerminationStrategy: PID 18854 died... 19:25:00.708824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18854): Terminated: ok {rc=0} 19:25:00.752925 --- ParallelTerminationStrategy: PID 18857 died... 19:25:00.771740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18857): Terminated: ok {rc=0} 19:25:00.865183 bus /gobi_0: Setting Powered False 19:25:01.982661 bus /gobi_0: Setting Powered False 19:25:03.109036 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:25:04.257661 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.269080 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:25:04.328362 tst iperf3.py: using LAC 30971 19:25:04.449027 tst iperf3.py: using RAC 116 19:25:04.567200 tst iperf3.py: using CellId 30971 19:25:04.687211 tst iperf3.py: using BVCI 30972 19:25:04.797208 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.808141 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.819032 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.829757 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.840251 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.850903 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.861700 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.872257 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:04.882978 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:25:05.001493 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:25:05.223026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:05.552055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18862): Launched 19:25:05.838612 run iperf3-srv_10.42.42.10(pid=18863): Launched 19:25:05.962768 tst iperf3.py:8: start network... 19:25:06.182670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:06.688455 run create_hlr_db(pid=18864): Launched 19:25:06.813572 bus /gobi_6: Setting Powered False 19:25:07.878139 run create_hlr_db(pid=18864): Terminated: ok {rc=0} 19:25:08.313719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Launched 19:25:08.618723 run osmo-hlr_10.42.42.2(pid=18867): Launched 19:25:08.736263 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:09.262280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Launched 19:25:09.566309 run osmo-stp_10.42.42.5(pid=18870): Launched 19:25:09.682304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:25:10.206977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Launched 19:25:10.325133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:25:10.582894 run patchelf(pid=18873): Launched 19:25:10.754082 run osmo-stp_10.42.42.5(pid=18870): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] 19:25:10.883137 run osmo-stp_10.42.42.5(pid=18870): stdout: | (launched: 2022-12-12_19:25:09.510110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:11.014394 run osmo-stp_10.42.42.5(pid=18870): stderr: | 20221212192509683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192509683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192509683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192509684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192509684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192509684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192509684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:11.146344 run osmo-stp_10.42.42.5(pid=18870): stdout: | (launched: 2022-12-12_19:25:09.510110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:11.270907 run osmo-stp_10.42.42.5(pid=18870): stderr: | 20221212192509683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192509683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192509683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192509684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192509684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192509684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192509684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:11.418601 run patchelf(pid=18873): Terminating (SIGINT) 19:25:11.588890 run patchelf(pid=18873): Terminated: ok {rc=0} 19:25:11.712032 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18870): Process ended prematurely: osmo-stp_10.42.42.5(pid=18870) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 19:25:11.721645 tst iperf3.py:8: Test FAILED (7.5 sec) 19:25:11.748910 run osmo-hlr_10.42.42.2(pid=18867): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18867)] 19:25:11.797167 run osmo-hlr_10.42.42.2(pid=18867): stdout: | (launched: 2022-12-12_19:25:08.562362) 19:25:11.847248 run osmo-hlr_10.42.42.2(pid=18867): stderr: | 20221212192508740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192508740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192508740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192508740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192508740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192508740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192508752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192508762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192508762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192508763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:11.898707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18862): Terminating (SIGTERM) 19:25:11.938946 run iperf3-srv_10.42.42.10(pid=18863): Terminating (SIGTERM) 19:25:11.979239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Terminating (SIGTERM) 19:25:12.019765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Terminating (SIGTERM) 19:25:12.059907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Terminating (SIGTERM) 19:25:12.100406 --- ParallelTerminationStrategy: PID 18862 died... 19:25:12.119939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18862): Terminated: ok {rc=0} 19:25:12.164854 --- ParallelTerminationStrategy: PID 18863 died... 19:25:12.184235 run iperf3-srv_10.42.42.10(pid=18863): Terminated {rc=256} 19:25:12.229227 --- ParallelTerminationStrategy: PID 18866 died... 19:25:12.248088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Terminated: ok {rc=0} 19:25:12.292892 --- ParallelTerminationStrategy: PID 18869 died... 19:25:12.312311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Terminated: ok {rc=0} 19:25:12.357076 --- ParallelTerminationStrategy: PID 18872 died... 19:25:12.375997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Terminated: ok {rc=0} 19:25:12.464163 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:25:13.617968 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:13.630329 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:25:13.689642 tst iperf3m4.py: using LAC 30972 19:25:13.810208 tst iperf3m4.py: using RAC 117 19:25:13.930874 tst iperf3m4.py: using CellId 30972 19:25:14.059913 tst iperf3m4.py: using BVCI 30973 19:25:14.179225 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.190878 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.202275 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.213897 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.225443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.236783 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.248431 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.259665 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:14.271415 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:25:14.392386 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:25:14.515116 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:25:14.632540 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:25:14.750916 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:25:14.958450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:15.265031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18874): Launched 19:25:15.531243 run iperf3-srv_10.42.42.10(pid=18875): Launched 19:25:15.645537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:25:15.853668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:16.239298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18876): Launched 19:25:16.522532 run iperf3-srv_10.42.42.10(pid=18877): Launched 19:25:16.664633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:25:16.891605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:17.228321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18878): Launched 19:25:17.500275 run iperf3-srv_10.42.42.10(pid=18879): Launched 19:25:17.615474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:25:17.817666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:18.123130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18880): Launched 19:25:18.390485 run iperf3-srv_10.42.42.10(pid=18881): Launched 19:25:18.504235 tst iperf3m4.py:8: start network... 19:25:18.706999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:19.180065 run create_hlr_db(pid=18882): Launched 19:25:19.304011 bus /gobi_6: Setting Powered False 19:25:20.365335 run create_hlr_db(pid=18882): Terminated: ok {rc=0} 19:25:20.811601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Launched 19:25:21.140043 run osmo-hlr_10.42.42.2(pid=18886): Launched 19:25:21.266627 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:21.831803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18888): Launched 19:25:22.160060 run osmo-stp_10.42.42.5(pid=18889): Launched 19:25:22.285482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:25:22.850472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18891): Launched 19:25:22.975242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:25:23.252127 run patchelf(pid=18892): Launched 19:25:23.435884 run osmo-stp_10.42.42.5(pid=18889): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18889)] 19:25:23.574787 run osmo-stp_10.42.42.5(pid=18889): stdout: | (launched: 2022-12-12_19:25:22.099871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:23.715787 run osmo-stp_10.42.42.5(pid=18889): stderr: | 20221212192522291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192522291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192522291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192522292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192522292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192522292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192522292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:23.855960 run osmo-stp_10.42.42.5(pid=18889): stdout: | (launched: 2022-12-12_19:25:22.099871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:23.989793 run osmo-stp_10.42.42.5(pid=18889): stderr: | 20221212192522291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192522291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192522291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192522292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192522292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192522292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192522292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:24.148423 run patchelf(pid=18892): Terminating (SIGINT) 19:25:24.331016 run patchelf(pid=18892): Terminated: ok {rc=0} 19:25:24.462762 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18889): Process ended prematurely: osmo-stp_10.42.42.5(pid=18889) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18889)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:25:24.472896 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:25:24.503735 run osmo-hlr_10.42.42.2(pid=18886): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18886)] 19:25:24.555077 run osmo-hlr_10.42.42.2(pid=18886): stdout: | (launched: 2022-12-12_19:25:21.079867) 19:25:24.608935 run osmo-hlr_10.42.42.2(pid=18886): stderr: | 20221212192521279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192521279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192521279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192521279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192521279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192521279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192521296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192521306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192521306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192521306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:24.662748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18874): Terminating (SIGTERM) 19:25:24.705670 run iperf3-srv_10.42.42.10(pid=18875): Terminating (SIGTERM) 19:25:24.748577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18876): Terminating (SIGTERM) 19:25:24.792211 run iperf3-srv_10.42.42.10(pid=18877): Terminating (SIGTERM) 19:25:24.835011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18878): Terminating (SIGTERM) 19:25:24.877957 run iperf3-srv_10.42.42.10(pid=18879): Terminating (SIGTERM) 19:25:24.920740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18880): Terminating (SIGTERM) 19:25:24.963561 run iperf3-srv_10.42.42.10(pid=18881): Terminating (SIGTERM) 19:25:25.006399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Terminating (SIGTERM) 19:25:25.049387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18888): Terminating (SIGTERM) 19:25:25.092207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18891): Terminating (SIGTERM) 19:25:25.135437 --- ParallelTerminationStrategy: PID 18874 died... 19:25:25.155801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18874): Terminated: ok {rc=0} 19:25:25.203556 --- ParallelTerminationStrategy: PID 18875 died... 19:25:25.223529 run iperf3-srv_10.42.42.10(pid=18875): Terminated {rc=256} 19:25:25.270768 --- ParallelTerminationStrategy: PID 18876 died... 19:25:25.290767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18876): Terminated: ok {rc=0} 19:25:25.338369 --- ParallelTerminationStrategy: PID 18877 died... 19:25:25.358514 run iperf3-srv_10.42.42.10(pid=18877): Terminated {rc=256} 19:25:25.405801 --- ParallelTerminationStrategy: PID 18878 died... 19:25:25.425706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18878): Terminated: ok {rc=0} 19:25:25.473072 --- ParallelTerminationStrategy: PID 18879 died... 19:25:25.492920 run iperf3-srv_10.42.42.10(pid=18879): Terminated {rc=256} 19:25:25.540145 --- ParallelTerminationStrategy: PID 18880 died... 19:25:25.560164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18880): Terminated: ok {rc=0} 19:25:25.607836 --- ParallelTerminationStrategy: PID 18881 died... 19:25:25.627846 run iperf3-srv_10.42.42.10(pid=18881): Terminated {rc=256} 19:25:25.675731 --- ParallelTerminationStrategy: PID 18884 died... 19:25:25.695801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18884): Terminated: ok {rc=0} 19:25:25.743383 --- ParallelTerminationStrategy: PID 18888 died... 19:25:25.763512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18888): Terminated: ok {rc=0} 19:25:25.811351 --- ParallelTerminationStrategy: PID 18891 died... 19:25:25.831333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18891): Terminated: ok {rc=0} 19:25:25.920593 bus /gobi_4: Setting Powered False 19:25:27.021807 bus /gobi_4: Setting Powered False 19:25:28.142981 bus /gobi_1: Setting Powered False 19:25:29.242553 bus /gobi_1: Setting Powered False 19:25:30.356446 bus /gobi_0: Setting Powered False 19:25:31.454425 bus /gobi_0: Setting Powered False 19:25:32.571451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:25:33.677109 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:33.688581 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:25:33.745385 tst ping.py: using LAC 30973 19:25:33.861914 tst ping.py: using RAC 118 19:25:33.982555 tst ping.py: using CellId 30973 19:25:34.099055 tst ping.py: using BVCI 30974 19:25:34.208104 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:34.219098 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:34.229894 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:34.240562 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:34.251283 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:34.261967 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:34.272759 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:34.283479 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:25:34.398305 tst ping.py:19: start network... 19:25:34.598300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:35.059815 run create_hlr_db(pid=18893): Launched 19:25:35.185628 bus /gobi_6: Setting Powered False 19:25:36.250027 run create_hlr_db(pid=18893): Terminated: ok {rc=0} 19:25:36.698483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Launched 19:25:37.020652 run osmo-hlr_10.42.42.2(pid=18896): Launched 19:25:37.145141 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:37.700243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Launched 19:25:38.020610 run osmo-stp_10.42.42.5(pid=18899): Launched 19:25:38.144616 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:25:38.700739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18901): Launched 19:25:38.823467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:25:39.096141 run patchelf(pid=18902): Launched 19:25:39.266539 run osmo-stp_10.42.42.5(pid=18899): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] 19:25:39.395649 run osmo-stp_10.42.42.5(pid=18899): stdout: | (launched: 2022-12-12_19:25:37.961449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:39.525926 run osmo-stp_10.42.42.5(pid=18899): stderr: | 20221212192538154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192538154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192538154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192538155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192538155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192538155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192538155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:39.656014 run osmo-stp_10.42.42.5(pid=18899): stdout: | (launched: 2022-12-12_19:25:37.961449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:39.779949 run osmo-stp_10.42.42.5(pid=18899): stderr: | 20221212192538154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192538154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192538154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192538155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192538155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192538155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192538155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:39.926937 run patchelf(pid=18902): Terminating (SIGINT) 19:25:40.095608 run patchelf(pid=18902): Terminated: ok {rc=0} 19:25:40.217181 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18899): Process ended prematurely: osmo-stp_10.42.42.5(pid=18899) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 19:25:40.226438 tst ping.py:22: Test FAILED (6.5 sec) 19:25:40.254741 run osmo-hlr_10.42.42.2(pid=18896): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18896)] 19:25:40.304279 run osmo-hlr_10.42.42.2(pid=18896): stdout: | (launched: 2022-12-12_19:25:36.961432) 19:25:40.355633 run osmo-hlr_10.42.42.2(pid=18896): stderr: | 20221212192537160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192537160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192537160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192537160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192537160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192537160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192537173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192537181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192537181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192537181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:40.407544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Terminating (SIGTERM) 19:25:40.449179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Terminating (SIGTERM) 19:25:40.490793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18901): Terminating (SIGTERM) 19:25:40.532515 --- ParallelTerminationStrategy: PID 18895 died... 19:25:40.552268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18895): Terminated: ok {rc=0} 19:25:40.598696 --- ParallelTerminationStrategy: PID 18898 died... 19:25:40.617770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18898): Terminated: ok {rc=0} 19:25:40.663649 --- ParallelTerminationStrategy: PID 18901 died... 19:25:40.682689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18901): Terminated: ok {rc=0} 19:25:40.771518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:25:41.861912 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:41.874105 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:25:41.958680 tst ping_idle_ping.py: using LAC 30974 19:25:42.079179 tst ping_idle_ping.py: using RAC 119 19:25:42.198516 tst ping_idle_ping.py: using CellId 30974 19:25:42.317983 tst ping_idle_ping.py: using BVCI 30975 19:25:42.426895 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:42.438036 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:42.448768 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:42.460131 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:42.471392 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:42.482679 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:42.495728 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:25:42.507847 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:25:42.624604 tst ping_idle_ping.py:24: start network... 19:25:42.825939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:43.291758 run create_hlr_db(pid=18903): Launched 19:25:43.415061 bus /gobi_6: Setting Powered False 19:25:44.476028 run create_hlr_db(pid=18903): Terminated: ok {rc=0} 19:25:44.917319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18905): Launched 19:25:45.240588 run osmo-hlr_10.42.42.2(pid=18906): Launched 19:25:45.366126 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:45.929191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18908): Launched 19:25:46.257709 run osmo-stp_10.42.42.5(pid=18909): Launched 19:25:46.396832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:25:47.114402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18911): Launched 19:25:47.251126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:25:47.529048 run patchelf(pid=18912): Launched 19:25:47.708915 run osmo-stp_10.42.42.5(pid=18909): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18909)] 19:25:47.845611 run osmo-stp_10.42.42.5(pid=18909): stdout: | (launched: 2022-12-12_19:25:46.197317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:47.983622 run osmo-stp_10.42.42.5(pid=18909): stderr: | 20221212192546572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192546572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192546573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192546573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192546578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192546578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192546578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:48.122187 run osmo-stp_10.42.42.5(pid=18909): stdout: | (launched: 2022-12-12_19:25:46.197317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:48.254703 run osmo-stp_10.42.42.5(pid=18909): stderr: | 20221212192546572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192546572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192546573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192546573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192546578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192546578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192546578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:48.411341 run patchelf(pid=18912): Terminating (SIGINT) 19:25:48.591458 run patchelf(pid=18912): Terminated: ok {rc=0} 19:25:48.722013 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18909): Process ended prematurely: osmo-stp_10.42.42.5(pid=18909) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18909)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:25:48.731946 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 19:25:48.761370 run osmo-hlr_10.42.42.2(pid=18906): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18906)] 19:25:48.812636 run osmo-hlr_10.42.42.2(pid=18906): stdout: | (launched: 2022-12-12_19:25:45.181336) 19:25:48.865729 run osmo-hlr_10.42.42.2(pid=18906): stderr: | 20221212192545380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192545380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192545380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192545380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192545380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192545380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192545392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192545401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192545401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192545401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:48.919110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18905): Terminating (SIGTERM) 19:25:48.961892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18908): Terminating (SIGTERM) 19:25:49.005086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18911): Terminating (SIGTERM) 19:25:49.048546 --- ParallelTerminationStrategy: PID 18905 died... 19:25:49.069173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18905): Terminated: ok {rc=0} 19:25:49.117054 --- ParallelTerminationStrategy: PID 18908 died... 19:25:49.137102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18908): Terminated: ok {rc=0} 19:25:49.184922 --- ParallelTerminationStrategy: PID 18911 died... 19:25:49.205157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18911): Terminated: ok {rc=0} 19:25:49.295445 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:25:50.595925 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:25:50.602683 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:25:50.624854 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:25:50.665728 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:25:50.754644 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:25:50.775918 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:25:50.816022 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:25:51.410270 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:25:51.463671 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:51.475224 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:25:51.534395 tst cs_paging_gprs_active.py: using LAC 30975 19:25:51.662953 tst cs_paging_gprs_active.py: using RAC 120 19:25:51.790074 tst cs_paging_gprs_active.py: using CellId 30975 19:25:51.922173 tst cs_paging_gprs_active.py: using BVCI 30976 19:25:52.041707 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.053210 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.064255 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.075880 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.087574 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.099321 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.111216 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.122916 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:25:52.134747 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:25:52.252296 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:25:52.373508 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:25:52.579016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:52.886599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18916): Launched 19:25:53.156508 run iperf3-srv_10.42.42.10(pid=18917): Launched 19:25:53.271238 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:25:53.477440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:25:53.785358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18918): Launched 19:25:54.052438 run iperf3-srv_10.42.42.10(pid=18919): Launched 19:25:54.167386 tst cs_paging_gprs_active.py:38: start network... 19:25:54.371658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:54.845721 run create_hlr_db(pid=18920): Launched 19:25:54.970640 bus /gobi_6: Setting Powered False 19:25:56.031452 run create_hlr_db(pid=18920): Terminated: ok {rc=0} 19:25:56.480928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18922): Launched 19:25:56.811654 run osmo-hlr_10.42.42.2(pid=18923): Launched 19:25:56.939355 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:57.474872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18925): Launched 19:25:57.784610 run osmo-stp_10.42.42.5(pid=18926): Launched 19:25:57.900043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:25:58.425645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18928): Launched 19:25:58.542584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:25:58.801589 run patchelf(pid=18929): Launched 19:25:58.971666 run osmo-stp_10.42.42.5(pid=18926): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18926)] 19:25:59.101905 run osmo-stp_10.42.42.5(pid=18926): stdout: | (launched: 2022-12-12_19:25:57.727890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:59.233456 run osmo-stp_10.42.42.5(pid=18926): stderr: | 20221212192557898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192557898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192557898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192557899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192557899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192557899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192557899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:59.364790 run osmo-stp_10.42.42.5(pid=18926): stdout: | (launched: 2022-12-12_19:25:57.727890) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:59.490814 run osmo-stp_10.42.42.5(pid=18926): stderr: | 20221212192557898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192557898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192557898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192557899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192557899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192557899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192557899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:59.639049 run patchelf(pid=18929): Terminating (SIGINT) 19:25:59.810413 run patchelf(pid=18929): Terminated: ok {rc=0} 19:25:59.934080 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18926): Process ended prematurely: osmo-stp_10.42.42.5(pid=18926) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18926)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:25:59.943550 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 19:25:59.970976 run osmo-hlr_10.42.42.2(pid=18923): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18923)] 19:26:00.019529 run osmo-hlr_10.42.42.2(pid=18923): stdout: | (launched: 2022-12-12_19:25:56.751609) 19:26:00.069699 run osmo-hlr_10.42.42.2(pid=18923): stderr: | 20221212192556950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192556950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192556950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192556950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192556950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192556950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192556965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192556975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192556975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192556975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:00.120096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18916): Terminating (SIGTERM) 19:26:00.160198 run iperf3-srv_10.42.42.10(pid=18917): Terminating (SIGTERM) 19:26:00.200412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18918): Terminating (SIGTERM) 19:26:00.240655 run iperf3-srv_10.42.42.10(pid=18919): Terminating (SIGTERM) 19:26:00.281006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18922): Terminating (SIGTERM) 19:26:00.321204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18925): Terminating (SIGTERM) 19:26:00.361635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18928): Terminating (SIGTERM) 19:26:00.402061 --- ParallelTerminationStrategy: PID 18916 died... 19:26:00.421290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18916): Terminated: ok {rc=0} 19:26:00.466260 --- ParallelTerminationStrategy: PID 18917 died... 19:26:00.485191 run iperf3-srv_10.42.42.10(pid=18917): Terminated {rc=256} 19:26:00.529384 --- ParallelTerminationStrategy: PID 18918 died... 19:26:00.548000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18918): Terminated: ok {rc=0} 19:26:00.592192 --- ParallelTerminationStrategy: PID 18919 died... 19:26:00.611043 run iperf3-srv_10.42.42.10(pid=18919): Terminated {rc=256} 19:26:00.655382 --- ParallelTerminationStrategy: PID 18922 died... 19:26:00.674197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18922): Terminated: ok {rc=0} 19:26:00.718532 --- ParallelTerminationStrategy: PID 18925 died... 19:26:00.737341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18925): Terminated: ok {rc=0} 19:26:00.782102 --- ParallelTerminationStrategy: PID 18928 died... 19:26:00.801050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18928): Terminated: ok {rc=0} 19:26:00.915877 bus /gobi_0: Setting Powered False 19:26:02.025787 bus /gobi_0: Setting Powered False 19:26:03.145797 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:26:04.296468 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.308801 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:26:04.370703 tst iperf3.py: using LAC 30976 19:26:04.500775 tst iperf3.py: using RAC 121 19:26:04.627759 tst iperf3.py: using CellId 30976 19:26:04.754983 tst iperf3.py: using BVCI 30977 19:26:04.874984 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.886527 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.897699 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.909239 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.920544 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.932025 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.943606 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.954958 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:04.966556 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:26:05.082413 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:26:05.286691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:05.594318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18930): Launched 19:26:05.863167 run iperf3-srv_10.42.42.10(pid=18931): Launched 19:26:05.977827 tst iperf3.py:8: start network... 19:26:06.181749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:06.655856 run create_hlr_db(pid=18932): Launched 19:26:06.782897 bus /gobi_6: Setting Powered False 19:26:07.844372 run create_hlr_db(pid=18932): Terminated: ok {rc=0} 19:26:08.273478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18935): Launched 19:26:08.578631 run osmo-hlr_10.42.42.2(pid=18936): Launched 19:26:08.694904 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:09.236039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18938): Launched 19:26:09.541550 run osmo-stp_10.42.42.5(pid=18939): Launched 19:26:09.657035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:10.184317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18941): Launched 19:26:10.301268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:10.558920 run patchelf(pid=18942): Launched 19:26:10.728301 run osmo-stp_10.42.42.5(pid=18939): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18939)] 19:26:10.857742 run osmo-stp_10.42.42.5(pid=18939): stdout: | (launched: 2022-12-12_19:26:09.484429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:10.988797 run osmo-stp_10.42.42.5(pid=18939): stderr: | 20221212192609659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192609659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192609659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192609660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192609660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192609660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192609660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:11.120109 run osmo-stp_10.42.42.5(pid=18939): stdout: | (launched: 2022-12-12_19:26:09.484429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:11.244879 run osmo-stp_10.42.42.5(pid=18939): stderr: | 20221212192609659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192609659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192609659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192609660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192609660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192609660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192609660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:11.392812 run patchelf(pid=18942): Terminating (SIGINT) 19:26:11.564283 run patchelf(pid=18942): Terminated: ok {rc=0} 19:26:11.688054 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18939): Process ended prematurely: osmo-stp_10.42.42.5(pid=18939) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18939)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 19:26:11.697761 tst iperf3.py:8: Test FAILED (7.4 sec) 19:26:11.724858 run osmo-hlr_10.42.42.2(pid=18936): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18936)] 19:26:11.773107 run osmo-hlr_10.42.42.2(pid=18936): stdout: | (launched: 2022-12-12_19:26:08.522064) 19:26:11.822881 run osmo-hlr_10.42.42.2(pid=18936): stderr: | 20221212192608702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192608702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192608702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192608702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192608702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192608702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192608715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192608723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192608724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192608724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:11.873376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18930): Terminating (SIGTERM) 19:26:11.914128 run iperf3-srv_10.42.42.10(pid=18931): Terminating (SIGTERM) 19:26:11.954142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18935): Terminating (SIGTERM) 19:26:11.994069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18938): Terminating (SIGTERM) 19:26:12.034036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18941): Terminating (SIGTERM) 19:26:12.074281 --- ParallelTerminationStrategy: PID 18930 died... 19:26:12.093549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18930): Terminated: ok {rc=0} 19:26:12.138115 --- ParallelTerminationStrategy: PID 18931 died... 19:26:12.156831 run iperf3-srv_10.42.42.10(pid=18931): Terminated {rc=256} 19:26:12.200708 --- ParallelTerminationStrategy: PID 18935 died... 19:26:12.219279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18935): Terminated: ok {rc=0} 19:26:12.263138 --- ParallelTerminationStrategy: PID 18938 died... 19:26:12.281810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18938): Terminated: ok {rc=0} 19:26:12.325605 --- ParallelTerminationStrategy: PID 18941 died... 19:26:12.344266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18941): Terminated: ok {rc=0} 19:26:12.431065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:26:13.585916 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:13.598277 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:26:13.659073 tst iperf3m4.py: using LAC 30977 19:26:13.787517 tst iperf3m4.py: using RAC 122 19:26:13.914123 tst iperf3m4.py: using CellId 30977 19:26:14.041300 tst iperf3m4.py: using BVCI 30978 19:26:14.161354 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.172824 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.184153 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.195916 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.207514 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.219037 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.230775 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.242397 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:14.254516 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:26:14.373704 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:26:14.496111 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:26:14.619235 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:26:14.738881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:26:14.958301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:15.285604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18943): Launched 19:26:15.569705 run iperf3-srv_10.42.42.10(pid=18944): Launched 19:26:15.692470 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:26:15.926874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:16.259316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18945): Launched 19:26:16.559053 run iperf3-srv_10.42.42.10(pid=18946): Launched 19:26:16.711561 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:26:16.926160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:17.289535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18947): Launched 19:26:17.556536 run iperf3-srv_10.42.42.10(pid=18948): Launched 19:26:17.672260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:26:17.875309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:26:18.181961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18949): Launched 19:26:18.450677 run iperf3-srv_10.42.42.10(pid=18950): Launched 19:26:18.566625 tst iperf3m4.py:8: start network... 19:26:18.770205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:19.243887 run create_hlr_db(pid=18951): Launched 19:26:19.368030 bus /gobi_6: Setting Powered False 19:26:20.429223 run create_hlr_db(pid=18951): Terminated: ok {rc=0} 19:26:20.877496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18953): Launched 19:26:21.205449 run osmo-hlr_10.42.42.2(pid=18954): Launched 19:26:21.331183 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:21.895552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18956): Launched 19:26:22.225426 run osmo-stp_10.42.42.5(pid=18957): Launched 19:26:22.349931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:22.915185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18959): Launched 19:26:23.042058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:23.318566 run patchelf(pid=18960): Launched 19:26:23.502247 run osmo-stp_10.42.42.5(pid=18957): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18957)] 19:26:23.641246 run osmo-stp_10.42.42.5(pid=18957): stdout: | (launched: 2022-12-12_19:26:22.164686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:23.782206 run osmo-stp_10.42.42.5(pid=18957): stderr: | 20221212192622357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192622357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192622357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192622358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192622358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192622358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192622358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:23.922794 run osmo-stp_10.42.42.5(pid=18957): stdout: | (launched: 2022-12-12_19:26:22.164686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:24.057186 run osmo-stp_10.42.42.5(pid=18957): stderr: | 20221212192622357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192622357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192622357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192622358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192622358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192622358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192622358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:24.216219 run patchelf(pid=18960): Terminating (SIGINT) 19:26:24.399040 run patchelf(pid=18960): Terminated: ok {rc=0} 19:26:24.531627 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18957): Process ended prematurely: osmo-stp_10.42.42.5(pid=18957) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18957)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:26:24.542228 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:26:24.571712 run osmo-hlr_10.42.42.2(pid=18954): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18954)] 19:26:24.623835 run osmo-hlr_10.42.42.2(pid=18954): stdout: | (launched: 2022-12-12_19:26:21.145260) 19:26:24.676873 run osmo-hlr_10.42.42.2(pid=18954): stderr: | 20221212192621345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192621345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192621345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192621345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192621345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192621345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192621358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192621366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192621366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192621367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:24.730048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18943): Terminating (SIGTERM) 19:26:24.772577 run iperf3-srv_10.42.42.10(pid=18944): Terminating (SIGTERM) 19:26:24.815378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18945): Terminating (SIGTERM) 19:26:24.858228 run iperf3-srv_10.42.42.10(pid=18946): Terminating (SIGTERM) 19:26:24.900800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18947): Terminating (SIGTERM) 19:26:24.943640 run iperf3-srv_10.42.42.10(pid=18948): Terminating (SIGTERM) 19:26:24.986872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18949): Terminating (SIGTERM) 19:26:25.029580 run iperf3-srv_10.42.42.10(pid=18950): Terminating (SIGTERM) 19:26:25.072669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18953): Terminating (SIGTERM) 19:26:25.115685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18956): Terminating (SIGTERM) 19:26:25.157972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18959): Terminating (SIGTERM) 19:26:25.201448 --- ParallelTerminationStrategy: PID 18943 died... 19:26:25.221348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18943): Terminated: ok {rc=0} 19:26:25.268869 --- ParallelTerminationStrategy: PID 18944 died... 19:26:25.288641 run iperf3-srv_10.42.42.10(pid=18944): Terminated {rc=256} 19:26:25.335360 --- ParallelTerminationStrategy: PID 18945 died... 19:26:25.355439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18945): Terminated: ok {rc=0} 19:26:25.402461 --- ParallelTerminationStrategy: PID 18946 died... 19:26:25.422082 run iperf3-srv_10.42.42.10(pid=18946): Terminated {rc=256} 19:26:25.469202 --- ParallelTerminationStrategy: PID 18947 died... 19:26:25.488943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18947): Terminated: ok {rc=0} 19:26:25.535692 --- ParallelTerminationStrategy: PID 18948 died... 19:26:25.555646 run iperf3-srv_10.42.42.10(pid=18948): Terminated {rc=256} 19:26:25.602615 --- ParallelTerminationStrategy: PID 18949 died... 19:26:25.622736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18949): Terminated: ok {rc=0} 19:26:25.670146 --- ParallelTerminationStrategy: PID 18950 died... 19:26:25.689870 run iperf3-srv_10.42.42.10(pid=18950): Terminated {rc=256} 19:26:25.736839 --- ParallelTerminationStrategy: PID 18953 died... 19:26:25.757295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18953): Terminated: ok {rc=0} 19:26:25.804590 --- ParallelTerminationStrategy: PID 18956 died... 19:26:25.824438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18956): Terminated: ok {rc=0} 19:26:25.871442 --- ParallelTerminationStrategy: PID 18959 died... 19:26:25.891358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18959): Terminated: ok {rc=0} 19:26:25.980608 bus /gobi_4: Setting Powered False 19:26:27.081436 bus /gobi_4: Setting Powered False 19:26:28.198630 bus /gobi_1: Setting Powered False 19:26:29.298822 bus /gobi_1: Setting Powered False 19:26:30.417301 bus /gobi_0: Setting Powered False 19:26:31.515297 bus /gobi_0: Setting Powered False 19:26:32.635408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:26:33.739887 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:33.752001 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:26:33.812482 tst ping.py: using LAC 30978 19:26:33.939427 tst ping.py: using RAC 123 19:26:34.063945 tst ping.py: using CellId 30978 19:26:34.190280 tst ping.py: using BVCI 30979 19:26:34.306122 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:34.317793 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:34.328921 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:34.340436 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:34.352009 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:34.363360 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:34.375071 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:34.386562 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:26:34.503772 tst ping.py:19: start network... 19:26:34.705626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:35.169786 run create_hlr_db(pid=18961): Launched 19:26:35.293024 bus /gobi_6: Setting Powered False 19:26:36.353398 run create_hlr_db(pid=18961): Terminated: ok {rc=0} 19:26:36.774328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18963): Launched 19:26:37.076105 run osmo-hlr_10.42.42.2(pid=18964): Launched 19:26:37.189383 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:37.710521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18966): Launched 19:26:38.010913 run osmo-stp_10.42.42.5(pid=18967): Launched 19:26:38.126256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:38.647416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18969): Launched 19:26:38.763208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:39.016164 run patchelf(pid=18970): Launched 19:26:39.182577 run osmo-stp_10.42.42.5(pid=18967): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18967)] 19:26:39.309691 run osmo-stp_10.42.42.5(pid=18967): stdout: | (launched: 2022-12-12_19:26:37.955192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:39.438197 run osmo-stp_10.42.42.5(pid=18967): stderr: | 20221212192638124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192638124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192638124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192638125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192638125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192638126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192638126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:39.566934 run osmo-stp_10.42.42.5(pid=18967): stdout: | (launched: 2022-12-12_19:26:37.955192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:39.689788 run osmo-stp_10.42.42.5(pid=18967): stderr: | 20221212192638124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192638124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192638124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192638125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192638125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192638126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192638126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:39.836314 run patchelf(pid=18970): Terminating (SIGINT) 19:26:40.003240 run patchelf(pid=18970): Terminated: ok {rc=0} 19:26:40.123673 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18967): Process ended prematurely: osmo-stp_10.42.42.5(pid=18967) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18967)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 19:26:40.132723 tst ping.py:22: Test FAILED (6.4 sec) 19:26:40.159645 run osmo-hlr_10.42.42.2(pid=18964): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18964)] 19:26:40.207585 run osmo-hlr_10.42.42.2(pid=18964): stdout: | (launched: 2022-12-12_19:26:37.020357) 19:26:40.257495 run osmo-hlr_10.42.42.2(pid=18964): stderr: | 20221212192637197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192637197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192637197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192637197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192637197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192637197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192637210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192637219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192637219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192637219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:40.307729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18963): Terminating (SIGTERM) 19:26:40.348040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18966): Terminating (SIGTERM) 19:26:40.388238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18969): Terminating (SIGTERM) 19:26:40.428712 --- ParallelTerminationStrategy: PID 18963 died... 19:26:40.448425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18963): Terminated: ok {rc=0} 19:26:40.493483 --- ParallelTerminationStrategy: PID 18966 died... 19:26:40.512369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18966): Terminated: ok {rc=0} 19:26:40.557207 --- ParallelTerminationStrategy: PID 18969 died... 19:26:40.576143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18969): Terminated: ok {rc=0} 19:26:40.662343 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:26:41.752474 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:41.764597 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:26:41.824738 tst ping_idle_ping.py: using LAC 30979 19:26:41.944437 tst ping_idle_ping.py: using RAC 124 19:26:42.062252 tst ping_idle_ping.py: using CellId 30979 19:26:42.189659 tst ping_idle_ping.py: using BVCI 30980 19:26:42.308367 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:42.320231 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:42.331744 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:42.344025 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:42.356467 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:42.368571 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:42.380891 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:26:42.393234 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:26:42.511962 tst ping_idle_ping.py:24: start network... 19:26:42.713634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:43.185793 run create_hlr_db(pid=18971): Launched 19:26:43.309339 bus /gobi_6: Setting Powered False 19:26:44.369289 run create_hlr_db(pid=18971): Terminated: ok {rc=0} 19:26:44.811092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18973): Launched 19:26:45.134511 run osmo-hlr_10.42.42.2(pid=18974): Launched 19:26:45.258394 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:45.814614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18976): Launched 19:26:46.133613 run osmo-stp_10.42.42.5(pid=18977): Launched 19:26:46.374098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:46.995510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18979): Launched 19:26:47.132265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:47.407906 run patchelf(pid=18980): Launched 19:26:47.588262 run osmo-stp_10.42.42.5(pid=18977): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18977)] 19:26:47.725532 run osmo-stp_10.42.42.5(pid=18977): stdout: | (launched: 2022-12-12_19:26:46.076041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:47.864068 run osmo-stp_10.42.42.5(pid=18977): stderr: | 20221212192646363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192646363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192646364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192646364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192646377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192646377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192646377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:48.002758 run osmo-stp_10.42.42.5(pid=18977): stdout: | (launched: 2022-12-12_19:26:46.076041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:48.135222 run osmo-stp_10.42.42.5(pid=18977): stderr: | 20221212192646363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192646363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192646364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192646364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192646377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192646377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192646377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:48.291994 run patchelf(pid=18980): Terminating (SIGINT) 19:26:48.472016 run patchelf(pid=18980): Terminated: ok {rc=0} 19:26:48.601882 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18977): Process ended prematurely: osmo-stp_10.42.42.5(pid=18977) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18977)] [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:26:48.611635 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 19:26:48.640900 run osmo-hlr_10.42.42.2(pid=18974): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18974)] 19:26:48.692344 run osmo-hlr_10.42.42.2(pid=18974): stdout: | (launched: 2022-12-12_19:26:45.074901) 19:26:48.745606 run osmo-hlr_10.42.42.2(pid=18974): stderr: | 20221212192645273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192645273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192645273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192645273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192645273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192645274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192645286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192645294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192645294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192645294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:48.799160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18973): Terminating (SIGTERM) 19:26:48.842159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18976): Terminating (SIGTERM) 19:26:48.884868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18979): Terminating (SIGTERM) 19:26:48.927964 --- ParallelTerminationStrategy: PID 18973 died... 19:26:48.948342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18973): Terminated: ok {rc=0} 19:26:48.996276 --- ParallelTerminationStrategy: PID 18976 died... 19:26:49.016058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18976): Terminated: ok {rc=0} 19:26:49.063344 --- ParallelTerminationStrategy: PID 18979 died... 19:26:49.083115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18979): Terminated: ok {rc=0} 19:26:49.173519 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:26:50.468185 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:26:50.475422 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:26:50.496827 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:26:50.532174 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:26:50.586807 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:26:50.607848 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:26:50.643993 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:26:51.201494 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:26:51.206825 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.218470 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:26:51.276619 tst switch_tch_pdch.py: using LAC 30980 19:26:51.402469 tst switch_tch_pdch.py: using RAC 125 19:26:51.526250 tst switch_tch_pdch.py: using CellId 30980 19:26:51.650915 tst switch_tch_pdch.py: using BVCI 30981 19:26:51.767776 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.779655 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.791139 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.802990 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.814675 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.826416 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.838388 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:26:51.850173 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:26:51.966130 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:26:52.084890 tst switch_tch_pdch.py:51: start network... 19:26:52.300039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:52.795837 run create_hlr_db(pid=18984): Launched 19:26:52.917996 bus /gobi_6: Setting Powered False 19:26:53.981203 run create_hlr_db(pid=18984): Terminated: ok {rc=0} 19:26:54.410426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18986): Launched 19:26:54.709478 run osmo-hlr_10.42.42.2(pid=18987): Launched 19:26:54.823672 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:55.352291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18989): Launched 19:26:55.650916 run osmo-stp_10.42.42.5(pid=18990): Launched 19:26:55.765967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:26:56.285986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18992): Launched 19:26:56.400358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:26:56.653510 run patchelf(pid=18993): Launched 19:26:56.821203 run osmo-stp_10.42.42.5(pid=18990): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18990)] 19:26:56.947558 run osmo-stp_10.42.42.5(pid=18990): stdout: | (launched: 2022-12-12_19:26:55.595371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:57.075863 run osmo-stp_10.42.42.5(pid=18990): stderr: | 20221212192655765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192655765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192655765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192655765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192655766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192655766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192655766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:57.204074 run osmo-stp_10.42.42.5(pid=18990): stdout: | (launched: 2022-12-12_19:26:55.595371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:57.326378 run osmo-stp_10.42.42.5(pid=18990): stderr: | 20221212192655765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192655765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192655765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192655765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192655766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192655766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192655766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:57.471373 run patchelf(pid=18993): Terminating (SIGINT) 19:26:57.638295 run patchelf(pid=18993): Terminated: ok {rc=0} 19:26:57.758633 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18990): Process ended prematurely: osmo-stp_10.42.42.5(pid=18990) [trial-2381↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18990)] [trial-2381↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:26:57.767438 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 19:26:57.794247 run osmo-hlr_10.42.42.2(pid=18987): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18987)] 19:26:57.842331 run osmo-hlr_10.42.42.2(pid=18987): stdout: | (launched: 2022-12-12_19:26:54.653974) 19:26:57.892196 run osmo-hlr_10.42.42.2(pid=18987): stderr: | 20221212192654829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192654829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192654829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192654830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192654830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192654830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192654842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192654851 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192654851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192654851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:57.942969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18986): Terminating (SIGTERM) 19:26:57.982808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18989): Terminating (SIGTERM) 19:26:58.022910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18992): Terminating (SIGTERM) 19:26:58.063103 --- ParallelTerminationStrategy: PID 18986 died... 19:26:58.082471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18986): Terminated: ok {rc=0} 19:26:58.126884 --- ParallelTerminationStrategy: PID 18989 died... 19:26:58.145622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18989): Terminated: ok {rc=0} 19:26:58.189534 --- ParallelTerminationStrategy: PID 18992 died... 19:26:58.208180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18992): Terminated: ok {rc=0} 19:26:58.294339 bus /gobi_0: Setting Powered False 19:26:59.395467 bus /gobi_0: Setting Powered False 19:27:00.513666 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:27:01.795453 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:01.802203 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:27:01.824237 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:27:01.861213 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:27:01.917336 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:27:01.944483 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:27:01.988129 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:27:02.525485 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:27:02.532541 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:02.544432 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:27:02.604400 tst switch_tch_pdch.py: using LAC 30981 19:27:02.731474 tst switch_tch_pdch.py: using RAC 126 19:27:02.856518 tst switch_tch_pdch.py: using CellId 30981 19:27:02.985723 tst switch_tch_pdch.py: using BVCI 30982 19:27:03.103793 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:03.115338 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:03.126625 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:03.138734 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:03.150742 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:03.162651 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:03.174850 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:27:03.186826 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:27:03.304730 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:27:03.420630 tst switch_tch_pdch.py:51: start network... 19:27:03.621576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:04.061947 run create_hlr_db(pid=18997): Launched 19:27:04.186450 bus /gobi_6: Setting Powered False 19:27:05.246962 run create_hlr_db(pid=18997): Terminated: ok {rc=0} 19:27:05.642098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18999): Launched 19:27:05.941632 run osmo-hlr_10.42.42.2(pid=19000): Launched 19:27:06.056442 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:06.559400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19002): Launched 19:27:06.860728 run osmo-stp_10.42.42.5(pid=19003): Launched 19:27:06.973865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:07.466531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19005): Launched 19:27:07.582836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:07.836286 run patchelf(pid=19006): Launched 19:27:08.002787 run osmo-stp_10.42.42.5(pid=19003): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19003)] 19:27:08.129506 run osmo-stp_10.42.42.5(pid=19003): stdout: | (launched: 2022-12-12_19:27:06.804310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:08.257659 run osmo-stp_10.42.42.5(pid=19003): stderr: | 20221212192706974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192706974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192706975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192706975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192706975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192706976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192706976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:08.385722 run osmo-stp_10.42.42.5(pid=19003): stdout: | (launched: 2022-12-12_19:27:06.804310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:08.507827 run osmo-stp_10.42.42.5(pid=19003): stderr: | 20221212192706974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192706974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192706975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192706975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192706975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192706976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192706976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:08.653396 run patchelf(pid=19006): Terminating (SIGINT) 19:27:08.819471 run patchelf(pid=19006): Terminated: ok {rc=0} 19:27:08.939739 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19003): Process ended prematurely: osmo-stp_10.42.42.5(pid=19003) [trial-2381↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19003)] [trial-2381↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:27:08.948698 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 19:27:08.975427 run osmo-hlr_10.42.42.2(pid=19000): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19000)] 19:27:09.023487 run osmo-hlr_10.42.42.2(pid=19000): stdout: | (launched: 2022-12-12_19:27:05.886289) 19:27:09.073813 run osmo-hlr_10.42.42.2(pid=19000): stderr: | 20221212192706063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192706063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192706063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192706063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192706063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192706063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192706074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192706083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192706083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192706083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:09.124430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18999): Terminating (SIGTERM) 19:27:09.165128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19002): Terminating (SIGTERM) 19:27:09.205658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19005): Terminating (SIGTERM) 19:27:09.246384 --- ParallelTerminationStrategy: PID 18999 died... 19:27:09.265771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18999): Terminated: ok {rc=0} 19:27:09.310381 --- ParallelTerminationStrategy: PID 19002 died... 19:27:09.329229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19002): Terminated: ok {rc=0} 19:27:09.373866 --- ParallelTerminationStrategy: PID 19005 died... 19:27:09.392595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19005): Terminated: ok {rc=0} 19:27:09.479160 bus /gobi_0: Setting Powered False 19:27:10.580309 bus /gobi_0: Setting Powered False 19:27:11.696752 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_sms:trx-b200 --------------------------------------------------------------------- 19:27:12.932594 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:12.936522 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 19:27:12.969772 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 19:27:12.976649 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 19:27:13.028108 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 19:27:13.061014 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 19:27:13.067802 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 19:27:13.608466 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 19:27:13.613787 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 19:27:13.624575 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 19:27:13.672855 tst mo_mt_sms.py: using LAC 30982 19:27:13.793865 tst mo_mt_sms.py: using RAC 127 19:27:13.909903 tst mo_mt_sms.py: using CellId 30982 19:27:14.024485 tst mo_mt_sms.py: using BVCI 30983 19:27:14.132426 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 19:27:14.251084 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 19:27:14.364523 tst mo_mt_sms.py:9: start nitb and bts... 19:27:14.564859 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:27:15.175443 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19010): Launched 19:27:15.474976 run osmo-nitb_10.42.42.2(pid=19011): Launched 19:27:15.642166 run osmo-nitb_10.42.42.2(pid=19011): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19011)] 19:27:15.777201 run osmo-nitb_10.42.42.2(pid=19011): stdout: | (launched: 2022-12-12_19:27:15.419332) 19:27:15.925231 run osmo-nitb_10.42.42.2(pid=19011): stderr: | (launched: 2022-12-12_19:27:15.463795) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:27:16.068715 run osmo-nitb_10.42.42.2(pid=19011): stdout: | (launched: 2022-12-12_19:27:15.419332) 19:27:16.213235 run osmo-nitb_10.42.42.2(pid=19011): stderr: | (launched: 2022-12-12_19:27:15.463795) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19011): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19011) [trial-2381↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19011)] 19:27:16.588837 tst osmo-nitb_10.42.42.2(pid=19011): stdout: | (launched: 2022-12-12_19:27:15.419332) 19:27:16.739127 tst osmo-nitb_10.42.42.2(pid=19011): stderr: | (launched: 2022-12-12_19:27:15.463795) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:27:16.897340 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19011): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19011) [trial-2381↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19011)] [trial-2381↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 19:27:16.907516 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 19:27:16.915776 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19010): Terminating (SIGTERM) 19:27:17.130716 --- ParallelTerminationStrategy: PID 19010 died... 19:27:17.158239 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19010): Terminated: ok {rc=0} 19:27:17.247852 bus /sierra_3: Setting Powered False 19:27:18.345429 bus /sierra_3: Setting Powered False 19:27:19.461981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:trx-b200 --------------------------------------------------------------------- 19:27:20.661630 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:20.666249 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 19:27:20.703325 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 19:27:20.731074 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 19:27:20.785713 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 19:27:20.819301 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 19:27:20.845871 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 19:27:21.391188 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 19:27:21.398345 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:21.409948 tst sms:trx-b200: Using 1 x bts (candidates: 1) 19:27:21.460302 tst mo_mt_sms.py: using LAC 30983 19:27:21.586751 tst mo_mt_sms.py: using RAC 128 19:27:21.704466 tst mo_mt_sms.py: using CellId 30983 19:27:21.819398 tst mo_mt_sms.py: using BVCI 30984 19:27:21.927126 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:21.937997 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:21.948618 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:21.959410 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:21.970121 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:21.980626 tst sms:trx-b200: Using 1 x modem (candidates: 2) 19:27:22.098208 tst sms:trx-b200: Using 1 x modem (candidates: 2) 19:27:22.216451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:22.713742 run create_hlr_db(pid=19015): Launched 19:27:22.835256 bus /sierra_2: Setting Powered False 19:27:23.898367 run create_hlr_db(pid=19015): Terminated: ok {rc=0} 19:27:24.327980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19017): Launched 19:27:24.627802 run osmo-hlr_10.42.42.2(pid=19018): Launched 19:27:24.743549 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:25.257305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19020): Launched 19:27:25.555156 run osmo-stp_10.42.42.5(pid=19021): Launched 19:27:25.671020 run osmo-msc_10.42.42.6: Starting osmo-msc 19:27:26.212558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19023): Launched 19:27:26.513039 run osmo-msc_10.42.42.6(pid=19024): Launched 19:27:26.682839 run osmo-stp_10.42.42.5(pid=19021): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19021)] 19:27:26.810037 run osmo-stp_10.42.42.5(pid=19021): stdout: | (launched: 2022-12-12_19:27:25.499901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:26.936349 run osmo-stp_10.42.42.5(pid=19021): stderr: | 20221212192725670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192725671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192725671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192725671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192725672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192725672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192725672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:27.061224 run osmo-stp_10.42.42.5(pid=19021): stdout: | (launched: 2022-12-12_19:27:25.499901) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:27.179980 run osmo-stp_10.42.42.5(pid=19021): stderr: | 20221212192725670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192725671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192725671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192725671 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192725672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192725672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192725672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:27.322071 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19021): Process ended prematurely: osmo-stp_10.42.42.5(pid=19021) [trial-2381↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19021)] [trial-2381↪sms:trx-b200↪mo_mt_sms.py:16] 19:27:27.330492 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 19:27:27.356604 run osmo-hlr_10.42.42.2(pid=19018): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19018)] 19:27:27.404644 run osmo-hlr_10.42.42.2(pid=19018): stdout: | (launched: 2022-12-12_19:27:24.572310) 19:27:27.454485 run osmo-hlr_10.42.42.2(pid=19018): stderr: | 20221212192724748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192724748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192724748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192724748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192724748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192724748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192724761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192724770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192724770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192724770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:27.523474 run osmo-msc_10.42.42.6(pid=19024): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19024)] 19:27:27.571300 run osmo-msc_10.42.42.6(pid=19024): stdout: | (launched: 2022-12-12_19:27:26.456021) 19:27:27.621068 run osmo-msc_10.42.42.6(pid=19024): stderr: | 20221212192726729 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192726730 DLGLOBAL DEBUG validating counter group 0x7fc279518c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192726730 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192726730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192726730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192726730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192726732 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192726732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192726732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192726732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:27:27.671097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19017): Terminating (SIGTERM) 19:27:27.710653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19020): Terminating (SIGTERM) 19:27:27.750823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19023): Terminating (SIGTERM) 19:27:27.790948 --- ParallelTerminationStrategy: PID 19017 died... 19:27:27.810107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19017): Terminated: ok {rc=0} 19:27:27.854475 --- ParallelTerminationStrategy: PID 19020 died... 19:27:27.873129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19020): Terminated: ok {rc=0} 19:27:27.917277 --- ParallelTerminationStrategy: PID 19023 died... 19:27:27.936028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19023): Terminated: ok {rc=0} 19:27:28.019614 bus /sierra_3: Setting Powered False 19:27:29.118040 bus /sierra_3: Setting Powered False 19:27:30.235391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-b200 --------------------------------------------------------------------- 19:27:31.505896 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:31.513772 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 19:27:31.552742 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 19:27:31.561135 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 19:27:31.599395 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 19:27:31.637734 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 19:27:31.646143 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 19:27:32.159891 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 19:27:32.165190 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 19:27:32.176930 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 19:27:32.224498 tst assert_extension.py: using LAC 30984 19:27:32.341639 tst assert_extension.py: using RAC 129 19:27:32.460347 tst assert_extension.py: using CellId 30984 19:27:32.591736 tst assert_extension.py: using BVCI 30985 19:27:32.710146 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 19:27:32.826902 tst assert_extension.py:10: start nitb and bts... 19:27:33.026368 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:27:33.637121 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19029): Launched 19:27:33.935482 run osmo-nitb_10.42.42.2(pid=19030): Launched 19:27:34.100792 run osmo-nitb_10.42.42.2(pid=19030): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19030)] 19:27:34.235852 run osmo-nitb_10.42.42.2(pid=19030): stdout: | (launched: 2022-12-12_19:27:33.880277) 19:27:34.371556 run osmo-nitb_10.42.42.2(pid=19030): stderr: | (launched: 2022-12-12_19:27:33.924463) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:27:34.507345 run osmo-nitb_10.42.42.2(pid=19030): stdout: | (launched: 2022-12-12_19:27:33.880277) 19:27:34.637539 run osmo-nitb_10.42.42.2(pid=19030): stderr: | (launched: 2022-12-12_19:27:33.924463) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19030): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19030) [trial-2381↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19030)] 19:27:35.048116 tst osmo-nitb_10.42.42.2(pid=19030): stdout: | (launched: 2022-12-12_19:27:33.880277) 19:27:35.168559 tst osmo-nitb_10.42.42.2(pid=19030): stderr: | (launched: 2022-12-12_19:27:33.924463) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:27:35.310649 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19030): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19030) [trial-2381↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19030)] [trial-2381↪nitb_ussd:trx-b200↪assert_extension.py:12] 19:27:35.319119 tst assert_extension.py:12: Test FAILED (3.1 sec) 19:27:35.325794 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19029): Terminating (SIGTERM) 19:27:35.534971 --- ParallelTerminationStrategy: PID 19029 died... 19:27:35.556151 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19029): Terminated: ok {rc=0} 19:27:35.642748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:trx-b200 --------------------------------------------------------------------- 19:27:36.827971 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:36.832460 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 19:27:36.867147 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 19:27:36.894604 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 19:27:36.930902 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 19:27:36.965448 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 19:27:36.993336 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 19:27:37.520764 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:trx-b200 assert_extension.py ---------------------------------------------- 19:27:37.526426 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:37.537668 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 19:27:37.587425 tst assert_extension.py: using LAC 30985 19:27:37.714283 tst assert_extension.py: using RAC 130 19:27:37.838319 tst assert_extension.py: using CellId 30985 19:27:37.962999 tst assert_extension.py: using BVCI 30986 19:27:38.078434 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:38.089745 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:38.100892 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:38.112614 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:38.124227 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 19:27:38.135852 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 19:27:38.250459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:38.714512 run create_hlr_db(pid=19034): Launched 19:27:38.838413 bus /sierra_2: Setting Powered False 19:27:39.898403 run create_hlr_db(pid=19034): Terminated: ok {rc=0} 19:27:40.337084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19036): Launched 19:27:40.657767 run osmo-hlr_10.42.42.2(pid=19037): Launched 19:27:40.782105 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:41.337684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19039): Launched 19:27:41.658975 run osmo-stp_10.42.42.5(pid=19040): Launched 19:27:41.785122 run osmo-msc_10.42.42.6: Starting osmo-msc 19:27:42.365133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19042): Launched 19:27:42.687905 run osmo-msc_10.42.42.6(pid=19043): Launched 19:27:42.866839 run osmo-stp_10.42.42.5(pid=19040): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19040)] 19:27:43.002263 run osmo-stp_10.42.42.5(pid=19040): stdout: | (launched: 2022-12-12_19:27:41.599301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:43.138347 run osmo-stp_10.42.42.5(pid=19040): stderr: | 20221212192741792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192741792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192741792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192741793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192741793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192741793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192741793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:43.273382 run osmo-stp_10.42.42.5(pid=19040): stdout: | (launched: 2022-12-12_19:27:41.599301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:43.401126 run osmo-stp_10.42.42.5(pid=19040): stderr: | 20221212192741792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192741792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192741792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192741793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192741793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192741793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192741793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:43.554001 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19040): Process ended prematurely: osmo-stp_10.42.42.5(pid=19040) [trial-2381↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19040)] [trial-2381↪ussd:trx-b200↪assert_extension.py:17] 19:27:43.563119 tst assert_extension.py:17: Test FAILED (6.0 sec) 19:27:43.591202 run osmo-hlr_10.42.42.2(pid=19037): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19037)] 19:27:43.642036 run osmo-hlr_10.42.42.2(pid=19037): stdout: | (launched: 2022-12-12_19:27:40.598534) 19:27:43.695231 run osmo-hlr_10.42.42.2(pid=19037): stderr: | 20221212192740796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192740796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192740796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192740796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192740796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192740797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192740808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192740818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192740818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192740818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:43.768554 run osmo-msc_10.42.42.6(pid=19043): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19043)] 19:27:43.819354 run osmo-msc_10.42.42.6(pid=19043): stdout: | (launched: 2022-12-12_19:27:42.627833) 19:27:43.871799 run osmo-msc_10.42.42.6(pid=19043): stderr: | 20221212192742948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192742949 DLGLOBAL DEBUG validating counter group 0x7f179926ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192742949 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192742949 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192742949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192742949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192742951 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192742951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192742951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192742952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:27:43.924828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19036): Terminating (SIGTERM) 19:27:43.967347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19039): Terminating (SIGTERM) 19:27:44.009878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19042): Terminating (SIGTERM) 19:27:44.052608 --- ParallelTerminationStrategy: PID 19036 died... 19:27:44.072835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19036): Terminated: ok {rc=0} 19:27:44.120373 --- ParallelTerminationStrategy: PID 19039 died... 19:27:44.140153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19039): Terminated: ok {rc=0} 19:27:44.187333 --- ParallelTerminationStrategy: PID 19042 died... 19:27:44.207174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19042): Terminated: ok {rc=0} 19:27:44.295552 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:27:45.511383 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:45.518549 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:27:45.553080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:27:45.580154 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:27:45.633623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:27:45.669088 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:27:45.696070 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:27:46.243923 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:27:46.310813 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:46.326767 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:27:46.418776 tst mo_mt_call.py: using LAC 30986 19:27:46.549167 tst mo_mt_call.py: using RAC 131 19:27:46.698925 tst mo_mt_call.py: using CellId 30986 19:27:46.824907 tst mo_mt_call.py: using BVCI 30987 19:27:46.947728 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:46.959886 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:46.971842 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:46.984353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:46.996665 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:47.008861 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:27:47.153442 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:27:47.276755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:47.783484 run create_hlr_db(pid=19048): Launched 19:27:47.907717 bus /sierra_2: Setting Powered False 19:27:48.972387 run create_hlr_db(pid=19048): Terminated: ok {rc=0} 19:27:49.426249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19050): Launched 19:27:49.754440 run osmo-hlr_10.42.42.2(pid=19051): Launched 19:27:49.878883 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:50.442611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19053): Launched 19:27:50.769755 run osmo-stp_10.42.42.5(pid=19054): Launched 19:27:50.895317 run osmo-msc_10.42.42.6: Starting osmo-msc 19:27:51.485456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19056): Launched 19:27:51.813836 run osmo-msc_10.42.42.6(pid=19057): Launched 19:27:52.058485 run osmo-stp_10.42.42.5(pid=19054): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19054)] 19:27:52.200430 run osmo-stp_10.42.42.5(pid=19054): stdout: | (launched: 2022-12-12_19:27:50.709798) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:52.339334 run osmo-stp_10.42.42.5(pid=19054): stderr: | 20221212192750902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192750902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192750903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192750903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192750903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192750903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192750903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:52.475732 run osmo-stp_10.42.42.5(pid=19054): stdout: | (launched: 2022-12-12_19:27:50.709798) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:52.606522 run osmo-stp_10.42.42.5(pid=19054): stderr: | 20221212192750902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192750902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192750903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192750903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192750903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192750903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192750903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:52.762841 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19054): Process ended prematurely: osmo-stp_10.42.42.5(pid=19054) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19054)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:27:52.772639 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:27:52.801718 run osmo-hlr_10.42.42.2(pid=19051): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19051)] 19:27:52.852856 run osmo-hlr_10.42.42.2(pid=19051): stdout: | (launched: 2022-12-12_19:27:49.694203) 19:27:52.905665 run osmo-hlr_10.42.42.2(pid=19051): stderr: | 20221212192749894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192749894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192749894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192749894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192749894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192749894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192749918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192749929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192749929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192749929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:52.978742 run osmo-msc_10.42.42.6(pid=19057): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19057)] 19:27:53.029677 run osmo-msc_10.42.42.6(pid=19057): stdout: | (launched: 2022-12-12_19:27:51.752877) 19:27:53.082664 run osmo-msc_10.42.42.6(pid=19057): stderr: | 20221212192752078 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192752078 DLGLOBAL DEBUG validating counter group 0x7f71a65f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192752078 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192752078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192752078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192752078 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192752080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192752080 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192752080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192752081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:27:53.136204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19050): Terminating (SIGTERM) 19:27:53.178555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19053): Terminating (SIGTERM) 19:27:53.221049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19056): Terminating (SIGTERM) 19:27:53.263657 --- ParallelTerminationStrategy: PID 19050 died... 19:27:53.283799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19050): Terminated: ok {rc=0} 19:27:53.331364 --- ParallelTerminationStrategy: PID 19053 died... 19:27:53.351139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19053): Terminated: ok {rc=0} 19:27:53.398686 --- ParallelTerminationStrategy: PID 19056 died... 19:27:53.418619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19056): Terminated: ok {rc=0} 19:27:53.508761 bus /sierra_3: Setting Powered False 19:27:54.610088 bus /sierra_3: Setting Powered False 19:27:55.728688 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:27:56.874888 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:56.886910 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:27:56.956835 tst mo_mt_call_osmux.py: using LAC 30987 19:27:57.077845 tst mo_mt_call_osmux.py: using RAC 132 19:27:57.201559 tst mo_mt_call_osmux.py: using CellId 30987 19:27:57.322521 tst mo_mt_call_osmux.py: using BVCI 30988 19:27:57.434317 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:57.445470 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:57.456542 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:57.467635 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:57.478836 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:27:57.489966 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:27:57.605386 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:27:57.727325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:58.233698 run create_hlr_db(pid=19059): Launched 19:27:58.360207 bus /sierra_2: Setting Powered False 19:27:59.425285 run create_hlr_db(pid=19059): Terminated: ok {rc=0} 19:27:59.863784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19061): Launched 19:28:00.169964 run osmo-hlr_10.42.42.2(pid=19062): Launched 19:28:00.285950 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:00.812142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19064): Launched 19:28:01.152165 run osmo-stp_10.42.42.5(pid=19065): Launched 19:28:01.270961 run osmo-msc_10.42.42.6: Starting osmo-msc 19:28:02.021734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19067): Launched 19:28:02.365343 run osmo-msc_10.42.42.6(pid=19068): Launched 19:28:02.550928 run osmo-stp_10.42.42.5(pid=19065): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19065)] 19:28:02.692519 run osmo-stp_10.42.42.5(pid=19065): stdout: | (launched: 2022-12-12_19:28:01.094672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:02.832346 run osmo-stp_10.42.42.5(pid=19065): stderr: | 20221212192801440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192801440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192801440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192801449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192801449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192801449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192801449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:02.969486 run osmo-stp_10.42.42.5(pid=19065): stdout: | (launched: 2022-12-12_19:28:01.094672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:03.100011 run osmo-stp_10.42.42.5(pid=19065): stderr: | 20221212192801440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192801440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192801440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192801449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192801449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192801449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192801449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:03.256123 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19065): Process ended prematurely: osmo-stp_10.42.42.5(pid=19065) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19065)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:28:03.266109 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:28:03.295221 run osmo-hlr_10.42.42.2(pid=19062): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19062)] 19:28:03.346550 run osmo-hlr_10.42.42.2(pid=19062): stdout: | (launched: 2022-12-12_19:28:00.113682) 19:28:03.399548 run osmo-hlr_10.42.42.2(pid=19062): stderr: | 20221212192800291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192800291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192800291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192800291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192800291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192800292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192800329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192800339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192800340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192800340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:03.473089 run osmo-msc_10.42.42.6(pid=19068): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19068)] 19:28:03.524404 run osmo-msc_10.42.42.6(pid=19068): stdout: | (launched: 2022-12-12_19:28:02.305135) 19:28:03.577364 run osmo-msc_10.42.42.6(pid=19068): stderr: | 20221212192802624 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192802624 DLGLOBAL DEBUG validating counter group 0x7f4342b58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192802624 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192802624 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192802625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192802625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192802626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192802627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192802627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192802627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:28:03.630647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19061): Terminating (SIGTERM) 19:28:03.674046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19064): Terminating (SIGTERM) 19:28:03.717035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19067): Terminating (SIGTERM) 19:28:03.760315 --- ParallelTerminationStrategy: PID 19061 died... 19:28:03.780867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19061): Terminated: ok {rc=0} 19:28:03.828856 --- ParallelTerminationStrategy: PID 19064 died... 19:28:03.849194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19064): Terminated: ok {rc=0} 19:28:03.896521 --- ParallelTerminationStrategy: PID 19067 died... 19:28:03.916530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19067): Terminated: ok {rc=0} 19:28:04.006313 bus /sierra_3: Setting Powered False 19:28:05.106307 bus /sierra_3: Setting Powered False 19:28:06.225146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:28:07.478396 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:28:07.485801 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:28:07.520027 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:28:07.547502 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:28:07.602892 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:28:07.636540 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:28:07.663108 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:28:08.214874 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:28:08.269498 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:08.281237 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:28:08.353109 tst mo_mt_call.py: using LAC 30988 19:28:08.480122 tst mo_mt_call.py: using RAC 133 19:28:08.606889 tst mo_mt_call.py: using CellId 30988 19:28:08.736453 tst mo_mt_call.py: using BVCI 30989 19:28:08.855953 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:08.867610 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:08.879615 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:08.891649 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:08.903537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:08.915623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:28:09.037959 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:28:09.158038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:09.664591 run create_hlr_db(pid=19074): Launched 19:28:09.791936 bus /sierra_2: Setting Powered False 19:28:10.855965 run create_hlr_db(pid=19074): Terminated: ok {rc=0} 19:28:11.311702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19076): Launched 19:28:11.640539 run osmo-hlr_10.42.42.2(pid=19077): Launched 19:28:11.768092 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:12.330642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19079): Launched 19:28:12.659583 run osmo-stp_10.42.42.5(pid=19080): Launched 19:28:12.786240 run osmo-msc_10.42.42.6: Starting osmo-msc 19:28:13.378159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19082): Launched 19:28:13.706312 run osmo-msc_10.42.42.6(pid=19083): Launched 19:28:13.889912 run osmo-stp_10.42.42.5(pid=19080): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19080)] 19:28:14.027540 run osmo-stp_10.42.42.5(pid=19080): stdout: | (launched: 2022-12-12_19:28:12.599471) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:14.165925 run osmo-stp_10.42.42.5(pid=19080): stderr: | 20221212192812795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192812795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192812795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192812796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192812796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192812796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192812797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:14.303167 run osmo-stp_10.42.42.5(pid=19080): stdout: | (launched: 2022-12-12_19:28:12.599471) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:14.433435 run osmo-stp_10.42.42.5(pid=19080): stderr: | 20221212192812795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192812795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192812795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192812796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192812796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192812796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192812797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:14.589458 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19080): Process ended prematurely: osmo-stp_10.42.42.5(pid=19080) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19080)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:28:14.599310 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:28:14.628391 run osmo-hlr_10.42.42.2(pid=19077): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19077)] 19:28:14.679827 run osmo-hlr_10.42.42.2(pid=19077): stdout: | (launched: 2022-12-12_19:28:11.580394) 19:28:14.732712 run osmo-hlr_10.42.42.2(pid=19077): stderr: | 20221212192811782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192811782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192811783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192811783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192811783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192811783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192811795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192811804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192811804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192811804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:14.805820 run osmo-msc_10.42.42.6(pid=19083): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19083)] 19:28:14.857194 run osmo-msc_10.42.42.6(pid=19083): stdout: | (launched: 2022-12-12_19:28:13.645847) 19:28:14.910073 run osmo-msc_10.42.42.6(pid=19083): stderr: | 20221212192813969 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192813969 DLGLOBAL DEBUG validating counter group 0x7fb2696e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192813969 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192813969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192813969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192813969 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192813971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192813971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192813972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192813972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:28:14.963569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19076): Terminating (SIGTERM) 19:28:15.006566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19079): Terminating (SIGTERM) 19:28:15.049760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19082): Terminating (SIGTERM) 19:28:15.093065 --- ParallelTerminationStrategy: PID 19076 died... 19:28:15.113555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19076): Terminated: ok {rc=0} 19:28:15.161739 --- ParallelTerminationStrategy: PID 19079 died... 19:28:15.181908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19079): Terminated: ok {rc=0} 19:28:15.229582 --- ParallelTerminationStrategy: PID 19082 died... 19:28:15.249658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19082): Terminated: ok {rc=0} 19:28:15.339134 bus /sierra_3: Setting Powered False 19:28:16.437152 bus /sierra_3: Setting Powered False 19:28:17.552528 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:28:18.704798 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:18.717508 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:28:18.790690 tst mo_mt_call_osmux.py: using LAC 30989 19:28:18.919336 tst mo_mt_call_osmux.py: using RAC 134 19:28:19.046944 tst mo_mt_call_osmux.py: using CellId 30989 19:28:19.174988 tst mo_mt_call_osmux.py: using BVCI 30990 19:28:19.293371 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:19.304913 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:19.316503 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:19.328528 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:19.340606 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:28:19.352812 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:28:19.472699 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:28:19.590882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:20.063631 run create_hlr_db(pid=19085): Launched 19:28:20.188537 bus /sierra_2: Setting Powered False 19:28:21.249578 run create_hlr_db(pid=19085): Terminated: ok {rc=0} 19:28:21.696602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19087): Launched 19:28:22.025781 run osmo-hlr_10.42.42.2(pid=19088): Launched 19:28:22.152510 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:22.714750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19090): Launched 19:28:23.042749 run osmo-stp_10.42.42.5(pid=19091): Launched 19:28:23.168282 run osmo-msc_10.42.42.6: Starting osmo-msc 19:28:23.765050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19093): Launched 19:28:24.093782 run osmo-msc_10.42.42.6(pid=19094): Launched 19:28:24.278486 run osmo-stp_10.42.42.5(pid=19091): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19091)] 19:28:24.417230 run osmo-stp_10.42.42.5(pid=19091): stdout: | (launched: 2022-12-12_19:28:22.982778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:24.555964 run osmo-stp_10.42.42.5(pid=19091): stderr: | 20221212192823175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192823175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192823175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192823176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192823176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192823176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192823176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:24.694401 run osmo-stp_10.42.42.5(pid=19091): stdout: | (launched: 2022-12-12_19:28:22.982778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:24.824858 run osmo-stp_10.42.42.5(pid=19091): stderr: | 20221212192823175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192823175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192823175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192823176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192823176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192823176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192823176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:24.981069 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19091): Process ended prematurely: osmo-stp_10.42.42.5(pid=19091) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19091)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:28:24.990906 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:28:25.019300 run osmo-hlr_10.42.42.2(pid=19088): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19088)] 19:28:25.070798 run osmo-hlr_10.42.42.2(pid=19088): stdout: | (launched: 2022-12-12_19:28:21.965749) 19:28:25.123754 run osmo-hlr_10.42.42.2(pid=19088): stderr: | 20221212192822165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192822165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192822165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192822165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192822165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192822165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192822177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192822186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192822186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192822186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:25.197153 run osmo-msc_10.42.42.6(pid=19094): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19094)] 19:28:25.247990 run osmo-msc_10.42.42.6(pid=19094): stdout: | (launched: 2022-12-12_19:28:24.033584) 19:28:25.300553 run osmo-msc_10.42.42.6(pid=19094): stderr: | 20221212192824356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192824356 DLGLOBAL DEBUG validating counter group 0x7f34ae019c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192824356 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192824356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192824356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192824357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192824358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192824359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192824359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192824359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:28:25.353703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19087): Terminating (SIGTERM) 19:28:25.395962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19090): Terminating (SIGTERM) 19:28:25.438386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19093): Terminating (SIGTERM) 19:28:25.481062 --- ParallelTerminationStrategy: PID 19087 died... 19:28:25.501284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19087): Terminated: ok {rc=0} 19:28:25.548714 --- ParallelTerminationStrategy: PID 19090 died... 19:28:25.568641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19090): Terminated: ok {rc=0} 19:28:25.615833 --- ParallelTerminationStrategy: PID 19093 died... 19:28:25.635616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19093): Terminated: ok {rc=0} 19:28:25.724667 bus /sierra_3: Setting Powered False 19:28:26.824485 bus /sierra_3: Setting Powered False 19:28:27.941328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:28:29.197956 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:28:29.205775 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:28:29.238736 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:28:29.265325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:28:29.318525 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:28:29.354086 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:28:29.381355 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:28:29.925906 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:28:29.975586 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:29.986812 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:28:30.057538 tst mo_mt_call.py: using LAC 30990 19:28:30.178304 tst mo_mt_call.py: using RAC 135 19:28:30.297297 tst mo_mt_call.py: using CellId 30990 19:28:30.416656 tst mo_mt_call.py: using BVCI 30991 19:28:30.526700 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:30.537891 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:30.548755 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:30.559703 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:30.571160 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:30.582771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:28:30.703528 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:28:30.820910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:31.319386 run create_hlr_db(pid=19099): Launched 19:28:31.481926 bus /sierra_2: Setting Powered False 19:28:32.543291 run create_hlr_db(pid=19099): Terminated: ok {rc=0} 19:28:32.992094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19101): Launched 19:28:33.321125 run osmo-hlr_10.42.42.2(pid=19102): Launched 19:28:33.446066 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:34.011632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Launched 19:28:34.339741 run osmo-stp_10.42.42.5(pid=19105): Launched 19:28:34.465974 run osmo-msc_10.42.42.6: Starting osmo-msc 19:28:35.058120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19107): Launched 19:28:35.386254 run osmo-msc_10.42.42.6(pid=19108): Launched 19:28:35.568616 run osmo-stp_10.42.42.5(pid=19105): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19105)] 19:28:35.706406 run osmo-stp_10.42.42.5(pid=19105): stdout: | (launched: 2022-12-12_19:28:34.279465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:35.844324 run osmo-stp_10.42.42.5(pid=19105): stderr: | 20221212192834473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192834473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192834473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192834474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192834474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192834474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192834474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:35.981895 run osmo-stp_10.42.42.5(pid=19105): stdout: | (launched: 2022-12-12_19:28:34.279465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:36.112243 run osmo-stp_10.42.42.5(pid=19105): stderr: | 20221212192834473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192834473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192834473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192834474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192834474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192834474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192834474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:36.268606 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19105): Process ended prematurely: osmo-stp_10.42.42.5(pid=19105) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19105)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:28:36.278461 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:28:36.306970 run osmo-hlr_10.42.42.2(pid=19102): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19102)] 19:28:36.358511 run osmo-hlr_10.42.42.2(pid=19102): stdout: | (launched: 2022-12-12_19:28:33.260923) 19:28:36.411632 run osmo-hlr_10.42.42.2(pid=19102): stderr: | 20221212192833459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192833459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192833459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192833459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192833459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192833459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192833472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192833480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192833480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192833480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:36.485084 run osmo-msc_10.42.42.6(pid=19108): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19108)] 19:28:36.536118 run osmo-msc_10.42.42.6(pid=19108): stdout: | (launched: 2022-12-12_19:28:35.325836) 19:28:36.588893 run osmo-msc_10.42.42.6(pid=19108): stderr: | 20221212192835649 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192835649 DLGLOBAL DEBUG validating counter group 0x7fd1b2d44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192835649 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192835649 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192835649 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192835649 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192835651 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192835651 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192835652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192835652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:28:36.642041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19101): Terminating (SIGTERM) 19:28:36.685160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Terminating (SIGTERM) 19:28:36.728102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19107): Terminating (SIGTERM) 19:28:36.770949 --- ParallelTerminationStrategy: PID 19101 died... 19:28:36.791339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19101): Terminated: ok {rc=0} 19:28:36.839045 --- ParallelTerminationStrategy: PID 19104 died... 19:28:36.858919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Terminated: ok {rc=0} 19:28:36.906286 --- ParallelTerminationStrategy: PID 19107 died... 19:28:36.926079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19107): Terminated: ok {rc=0} 19:28:37.016686 bus /sierra_3: Setting Powered False 19:28:38.113733 bus /sierra_3: Setting Powered False 19:28:39.230109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:28:40.377974 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:40.389700 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:28:40.458384 tst mo_mt_call_osmux.py: using LAC 30991 19:28:40.576778 tst mo_mt_call_osmux.py: using RAC 136 19:28:40.695599 tst mo_mt_call_osmux.py: using CellId 30991 19:28:40.817422 tst mo_mt_call_osmux.py: using BVCI 30992 19:28:40.926935 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:40.938205 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:40.949297 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:40.960232 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:40.971238 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:28:40.982176 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:28:41.098868 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:28:41.215798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:41.688370 run create_hlr_db(pid=19110): Launched 19:28:41.812309 bus /sierra_2: Setting Powered False 19:28:42.873844 run create_hlr_db(pid=19110): Terminated: ok {rc=0} 19:28:43.298781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19112): Launched 19:28:43.628529 run osmo-hlr_10.42.42.2(pid=19113): Launched 19:28:43.755349 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:44.318874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19115): Launched 19:28:44.647447 run osmo-stp_10.42.42.5(pid=19116): Launched 19:28:44.776368 run osmo-msc_10.42.42.6: Starting osmo-msc 19:28:45.370624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19118): Launched 19:28:45.699597 run osmo-msc_10.42.42.6(pid=19119): Launched 19:28:45.939708 run osmo-stp_10.42.42.5(pid=19116): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19116)] 19:28:46.254328 run osmo-stp_10.42.42.5(pid=19116): stdout: | (launched: 2022-12-12_19:28:44.587553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:46.500458 run osmo-stp_10.42.42.5(pid=19116): stderr: | 20221212192844781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192844781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192844782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192844782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192844782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192844783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192844783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:46.631142 run osmo-stp_10.42.42.5(pid=19116): stdout: | (launched: 2022-12-12_19:28:44.587553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:46.758949 run osmo-stp_10.42.42.5(pid=19116): stderr: | 20221212192844781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192844781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192844782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192844782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192844782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192844783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192844783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:46.910519 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19116): Process ended prematurely: osmo-stp_10.42.42.5(pid=19116) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19116)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:28:46.920423 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 19:28:46.948621 run osmo-hlr_10.42.42.2(pid=19113): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19113)] 19:28:46.999828 run osmo-hlr_10.42.42.2(pid=19113): stdout: | (launched: 2022-12-12_19:28:43.567875) 19:28:47.051728 run osmo-hlr_10.42.42.2(pid=19113): stderr: | 20221212192843765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192843765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192843765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192843766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192843766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192843766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192843778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192843787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192843788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192843788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:47.124633 run osmo-msc_10.42.42.6(pid=19119): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19119)] 19:28:47.174241 run osmo-msc_10.42.42.6(pid=19119): stdout: | (launched: 2022-12-12_19:28:45.638831) 19:28:47.225990 run osmo-msc_10.42.42.6(pid=19119): stderr: | 20221212192846092 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192846092 DLGLOBAL DEBUG validating counter group 0x7fe002f26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192846093 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192846093 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192846093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192846093 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192846095 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192846095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192846095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192846095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:28:47.278860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19112): Terminating (SIGTERM) 19:28:47.323578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19115): Terminating (SIGTERM) 19:28:47.367110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19118): Terminating (SIGTERM) 19:28:47.410241 --- ParallelTerminationStrategy: PID 19112 died... 19:28:47.429456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19112): Terminated: ok {rc=0} 19:28:47.473895 --- ParallelTerminationStrategy: PID 19115 died... 19:28:47.492587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19115): Terminated: ok {rc=0} 19:28:47.536679 --- ParallelTerminationStrategy: PID 19118 died... 19:28:47.555489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19118): Terminated: ok {rc=0} 19:28:47.641761 bus /sierra_3: Setting Powered False 19:28:48.746127 bus /sierra_3: Setting Powered False 19:28:49.864282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:28:51.122232 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:28:51.130050 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:28:51.163089 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:28:51.189813 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:28:51.242261 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:28:51.275984 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:28:51.302486 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:28:51.851009 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:28:51.899828 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:28:51.910941 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:28:51.979852 tst mo_mt_call.py: using LAC 30992 19:28:52.101455 tst mo_mt_call.py: using RAC 137 19:28:52.228805 tst mo_mt_call.py: using CellId 30992 19:28:52.355485 tst mo_mt_call.py: using BVCI 30993 19:28:52.473248 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:28:52.484767 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:28:52.496142 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:28:52.507900 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:28:52.519634 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:28:52.531364 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:28:52.647779 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:28:52.766798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:53.274216 run create_hlr_db(pid=19124): Launched 19:28:53.398359 bus /sierra_2: Setting Powered False 19:28:54.462870 run create_hlr_db(pid=19124): Terminated: ok {rc=0} 19:28:54.901963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19126): Launched 19:28:55.208151 run osmo-hlr_10.42.42.2(pid=19127): Launched 19:28:55.324213 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:55.864883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19129): Launched 19:28:56.170358 run osmo-stp_10.42.42.5(pid=19130): Launched 19:28:56.288218 run osmo-msc_10.42.42.6: Starting osmo-msc 19:28:56.843630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19132): Launched 19:28:57.150280 run osmo-msc_10.42.42.6(pid=19133): Launched 19:28:57.320535 run osmo-stp_10.42.42.5(pid=19130): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19130)] 19:28:57.449522 run osmo-stp_10.42.42.5(pid=19130): stdout: | (launched: 2022-12-12_19:28:56.113597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:57.578457 run osmo-stp_10.42.42.5(pid=19130): stderr: | 20221212192856284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192856284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192856284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192856285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192856285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192856285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192856285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:57.705675 run osmo-stp_10.42.42.5(pid=19130): stdout: | (launched: 2022-12-12_19:28:56.113597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:57.827454 run osmo-stp_10.42.42.5(pid=19130): stderr: | 20221212192856284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192856284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192856284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192856285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192856285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192856285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192856285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:57.972303 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19130): Process ended prematurely: osmo-stp_10.42.42.5(pid=19130) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19130)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:28:57.981450 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:28:58.008054 run osmo-hlr_10.42.42.2(pid=19127): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19127)] 19:28:58.056042 run osmo-hlr_10.42.42.2(pid=19127): stdout: | (launched: 2022-12-12_19:28:55.151480) 19:28:58.105864 run osmo-hlr_10.42.42.2(pid=19127): stderr: | 20221212192855328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192855328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192855328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192855328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192855328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192855329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192855341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192855350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192855351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192855351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:58.174976 run osmo-msc_10.42.42.6(pid=19133): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19133)] 19:28:58.222928 run osmo-msc_10.42.42.6(pid=19133): stdout: | (launched: 2022-12-12_19:28:57.093236) 19:28:58.272525 run osmo-msc_10.42.42.6(pid=19133): stderr: | 20221212192857366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192857366 DLGLOBAL DEBUG validating counter group 0x7f8b37703c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192857366 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192857366 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192857366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192857367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192857368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192857369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192857369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192857369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:28:58.322534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19126): Terminating (SIGTERM) 19:28:58.362196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19129): Terminating (SIGTERM) 19:28:58.401763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19132): Terminating (SIGTERM) 19:28:58.441677 --- ParallelTerminationStrategy: PID 19126 died... 19:28:58.460800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19126): Terminated: ok {rc=0} 19:28:58.505218 --- ParallelTerminationStrategy: PID 19129 died... 19:28:58.523873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19129): Terminated: ok {rc=0} 19:28:58.567953 --- ParallelTerminationStrategy: PID 19132 died... 19:28:58.586808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19132): Terminated: ok {rc=0} 19:28:58.672050 bus /sierra_3: Setting Powered False 19:28:59.771385 bus /sierra_3: Setting Powered False 19:29:00.931526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:29:02.107219 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:29:02.123437 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:29:02.207806 tst mo_mt_call_osmux.py: using LAC 30993 19:29:02.342358 tst mo_mt_call_osmux.py: using RAC 138 19:29:02.468327 tst mo_mt_call_osmux.py: using CellId 30993 19:29:02.594354 tst mo_mt_call_osmux.py: using BVCI 30994 19:29:02.713379 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:29:02.725094 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:29:02.736500 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:29:02.748597 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:29:02.760367 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:29:02.772159 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:29:02.893375 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:29:03.014544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:03.521932 run create_hlr_db(pid=19135): Launched 19:29:03.646138 bus /sierra_2: Setting Powered False 19:29:04.711140 run create_hlr_db(pid=19135): Terminated: ok {rc=0} 19:29:05.149839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Launched 19:29:05.455190 run osmo-hlr_10.42.42.2(pid=19138): Launched 19:29:05.571620 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:06.112859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19140): Launched 19:29:06.418105 run osmo-stp_10.42.42.5(pid=19141): Launched 19:29:06.534122 run osmo-msc_10.42.42.6: Starting osmo-msc 19:29:07.087303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19143): Launched 19:29:07.393565 run osmo-msc_10.42.42.6(pid=19144): Launched 19:29:07.564261 run osmo-stp_10.42.42.5(pid=19141): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19141)] 19:29:07.696150 run osmo-stp_10.42.42.5(pid=19141): stdout: | (launched: 2022-12-12_19:29:06.361602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:07.825839 run osmo-stp_10.42.42.5(pid=19141): stderr: | 20221212192906533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192906533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192906534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192906534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192906534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192906535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192906535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:07.952320 run osmo-stp_10.42.42.5(pid=19141): stdout: | (launched: 2022-12-12_19:29:06.361602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:08.072908 run osmo-stp_10.42.42.5(pid=19141): stderr: | 20221212192906533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192906533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192906534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192906534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192906534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192906535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192906535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:08.218061 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19141): Process ended prematurely: osmo-stp_10.42.42.5(pid=19141) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19141)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:29:08.227040 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:29:08.253347 run osmo-hlr_10.42.42.2(pid=19138): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19138)] 19:29:08.301141 run osmo-hlr_10.42.42.2(pid=19138): stdout: | (launched: 2022-12-12_19:29:05.398958) 19:29:08.350595 run osmo-hlr_10.42.42.2(pid=19138): stderr: | 20221212192905577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192905577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192905577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192905577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192905577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192905577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192905590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192905599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192905599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192905599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:08.419938 run osmo-msc_10.42.42.6(pid=19144): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19144)] 19:29:08.467823 run osmo-msc_10.42.42.6(pid=19144): stdout: | (launched: 2022-12-12_19:29:07.336243) 19:29:08.517528 run osmo-msc_10.42.42.6(pid=19144): stderr: | 20221212192907611 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192907611 DLGLOBAL DEBUG validating counter group 0x7f1500900c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192907611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192907611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192907611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192907611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192907613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192907614 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192907614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192907614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:29:08.567354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Terminating (SIGTERM) 19:29:08.606935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19140): Terminating (SIGTERM) 19:29:08.646741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19143): Terminating (SIGTERM) 19:29:08.686799 --- ParallelTerminationStrategy: PID 19137 died... 19:29:08.706057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Terminated: ok {rc=0} 19:29:08.750567 --- ParallelTerminationStrategy: PID 19140 died... 19:29:08.769424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19140): Terminated: ok {rc=0} 19:29:08.813589 --- ParallelTerminationStrategy: PID 19143 died... 19:29:08.832316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19143): Terminated: ok {rc=0} 19:29:08.916091 bus /sierra_3: Setting Powered False 19:29:10.015728 bus /sierra_3: Setting Powered False 19:29:11.131356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:29:12.384090 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:29:12.391191 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:29:12.426316 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:29:12.454108 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:29:12.508126 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:29:12.542462 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:29:12.570160 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:29:13.120196 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:29:13.173130 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:13.184561 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:29:13.255824 tst mo_mt_call.py: using LAC 30994 19:29:13.386943 tst mo_mt_call.py: using RAC 139 19:29:13.514169 tst mo_mt_call.py: using CellId 30994 19:29:13.639990 tst mo_mt_call.py: using BVCI 30995 19:29:13.758877 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:13.770468 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:13.781925 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:13.794211 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:13.806429 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:13.818274 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:29:13.937620 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:29:14.055743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:14.565136 run create_hlr_db(pid=19150): Launched 19:29:14.691509 bus /sierra_2: Setting Powered False 19:29:15.756481 run create_hlr_db(pid=19150): Terminated: ok {rc=0} 19:29:16.233812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19152): Launched 19:29:16.578659 run osmo-hlr_10.42.42.2(pid=19153): Launched 19:29:16.859043 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:17.550656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19155): Launched 19:29:17.880085 run osmo-stp_10.42.42.5(pid=19156): Launched 19:29:18.006120 run osmo-msc_10.42.42.6: Starting osmo-msc 19:29:18.597982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19158): Launched 19:29:18.926306 run osmo-msc_10.42.42.6(pid=19159): Launched 19:29:19.110417 run osmo-stp_10.42.42.5(pid=19156): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19156)] 19:29:19.249466 run osmo-stp_10.42.42.5(pid=19156): stdout: | (launched: 2022-12-12_19:29:17.819596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:19.388032 run osmo-stp_10.42.42.5(pid=19156): stderr: | 20221212192918011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192918011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192918011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192918012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192918012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192918012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192918013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:19.525319 run osmo-stp_10.42.42.5(pid=19156): stdout: | (launched: 2022-12-12_19:29:17.819596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:19.655340 run osmo-stp_10.42.42.5(pid=19156): stderr: | 20221212192918011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192918011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192918011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192918012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192918012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192918012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192918013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:19.811947 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19156): Process ended prematurely: osmo-stp_10.42.42.5(pid=19156) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19156)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:29:19.821832 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:29:19.850377 run osmo-hlr_10.42.42.2(pid=19153): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19153)] 19:29:19.901334 run osmo-hlr_10.42.42.2(pid=19153): stdout: | (launched: 2022-12-12_19:29:16.515754) 19:29:19.953943 run osmo-hlr_10.42.42.2(pid=19153): stderr: | 20221212192916918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192916918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192916918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192916918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192916918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192916918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192916941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192916953 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192916954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192916954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:20.027082 run osmo-msc_10.42.42.6(pid=19159): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19159)] 19:29:20.078109 run osmo-msc_10.42.42.6(pid=19159): stdout: | (launched: 2022-12-12_19:29:18.865869) 19:29:20.130659 run osmo-msc_10.42.42.6(pid=19159): stderr: | 20221212192919190 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192919190 DLGLOBAL DEBUG validating counter group 0x7f135dd3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192919190 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192919190 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192919190 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192919191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192919192 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192919193 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192919193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192919193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:29:20.184477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19152): Terminating (SIGTERM) 19:29:20.226748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19155): Terminating (SIGTERM) 19:29:20.269045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19158): Terminating (SIGTERM) 19:29:20.311542 --- ParallelTerminationStrategy: PID 19152 died... 19:29:20.331891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19152): Terminated: ok {rc=0} 19:29:20.379297 --- ParallelTerminationStrategy: PID 19155 died... 19:29:20.398961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19155): Terminated: ok {rc=0} 19:29:20.446556 --- ParallelTerminationStrategy: PID 19158 died... 19:29:20.466411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19158): Terminated: ok {rc=0} 19:29:20.556089 bus /sierra_3: Setting Powered False 19:29:21.656335 bus /sierra_3: Setting Powered False 19:29:22.774194 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:29:23.925934 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:23.938355 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:29:24.010662 tst mo_mt_call_osmux.py: using LAC 30995 19:29:24.137601 tst mo_mt_call_osmux.py: using RAC 140 19:29:24.259015 tst mo_mt_call_osmux.py: using CellId 30995 19:29:24.381095 tst mo_mt_call_osmux.py: using BVCI 30996 19:29:24.491700 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:24.503081 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:24.514258 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:24.526174 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:24.537898 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:29:24.549445 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:29:24.665988 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:29:24.782848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:25.258983 run create_hlr_db(pid=19161): Launched 19:29:25.384900 bus /sierra_2: Setting Powered False 19:29:26.446134 run create_hlr_db(pid=19161): Terminated: ok {rc=0} 19:29:26.896138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19163): Launched 19:29:27.225655 run osmo-hlr_10.42.42.2(pid=19164): Launched 19:29:27.352476 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:27.918783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19166): Launched 19:29:28.249130 run osmo-stp_10.42.42.5(pid=19167): Launched 19:29:28.374870 run osmo-msc_10.42.42.6: Starting osmo-msc 19:29:28.970884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19169): Launched 19:29:29.301974 run osmo-msc_10.42.42.6(pid=19170): Launched 19:29:29.488339 run osmo-stp_10.42.42.5(pid=19167): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19167)] 19:29:29.627148 run osmo-stp_10.42.42.5(pid=19167): stdout: | (launched: 2022-12-12_19:29:28.188451) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:29.767170 run osmo-stp_10.42.42.5(pid=19167): stderr: | 20221212192928383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192928383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192928384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192928384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192928385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192928385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192928385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:29.904923 run osmo-stp_10.42.42.5(pid=19167): stdout: | (launched: 2022-12-12_19:29:28.188451) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:30.035103 run osmo-stp_10.42.42.5(pid=19167): stderr: | 20221212192928383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192928383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192928384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192928384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192928385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192928385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192928385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:30.191332 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19167): Process ended prematurely: osmo-stp_10.42.42.5(pid=19167) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19167)] [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:29:30.200904 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:29:30.229832 run osmo-hlr_10.42.42.2(pid=19164): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19164)] 19:29:30.280765 run osmo-hlr_10.42.42.2(pid=19164): stdout: | (launched: 2022-12-12_19:29:27.165307) 19:29:30.333888 run osmo-hlr_10.42.42.2(pid=19164): stderr: | 20221212192927364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192927364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192927364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192927364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192927364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192927364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192927382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192927390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192927390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192927390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:30.407791 run osmo-msc_10.42.42.6(pid=19170): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19170)] 19:29:30.458734 run osmo-msc_10.42.42.6(pid=19170): stdout: | (launched: 2022-12-12_19:29:29.240202) 19:29:30.511808 run osmo-msc_10.42.42.6(pid=19170): stderr: | 20221212192929564 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192929565 DLGLOBAL DEBUG validating counter group 0x7f26ae322c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192929565 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192929565 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192929565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192929565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192929567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192929567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192929567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192929567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:29:30.564871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19163): Terminating (SIGTERM) 19:29:30.607535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19166): Terminating (SIGTERM) 19:29:30.650278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19169): Terminating (SIGTERM) 19:29:30.693177 --- ParallelTerminationStrategy: PID 19163 died... 19:29:30.713862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19163): Terminated: ok {rc=0} 19:29:30.761974 --- ParallelTerminationStrategy: PID 19166 died... 19:29:30.781711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19166): Terminated: ok {rc=0} 19:29:30.829728 --- ParallelTerminationStrategy: PID 19169 died... 19:29:30.851010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19169): Terminated: ok {rc=0} 19:29:30.947482 bus /sierra_3: Setting Powered False 19:29:32.051577 bus /sierra_3: Setting Powered False 19:29:33.172054 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:29:34.428185 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:29:34.435618 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:29:34.472359 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:29:34.500255 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:29:34.553983 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:29:34.588262 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:29:34.614855 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:29:35.169397 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:29:35.220644 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:35.232109 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:29:35.302416 tst mo_mt_call.py: using LAC 30996 19:29:35.426664 tst mo_mt_call.py: using RAC 141 19:29:35.554123 tst mo_mt_call.py: using CellId 30996 19:29:35.680245 tst mo_mt_call.py: using BVCI 30997 19:29:35.790684 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:35.802260 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:35.813503 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:35.824736 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:35.836008 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:35.847220 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:29:35.965959 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:29:36.088278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:36.596707 run create_hlr_db(pid=19179): Launched 19:29:36.722481 bus /sierra_2: Setting Powered False 19:29:37.787746 run create_hlr_db(pid=19179): Terminated: ok {rc=0} 19:29:38.224466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19181): Launched 19:29:38.530274 run osmo-hlr_10.42.42.2(pid=19182): Launched 19:29:38.646862 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:39.173350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19184): Launched 19:29:39.479521 run osmo-stp_10.42.42.5(pid=19185): Launched 19:29:39.597935 run osmo-msc_10.42.42.6: Starting osmo-msc 19:29:40.158114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19187): Launched 19:29:40.465524 run osmo-msc_10.42.42.6(pid=19188): Launched 19:29:40.636263 run osmo-stp_10.42.42.5(pid=19185): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19185)] 19:29:40.764719 run osmo-stp_10.42.42.5(pid=19185): stdout: | (launched: 2022-12-12_19:29:39.422345) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:40.892849 run osmo-stp_10.42.42.5(pid=19185): stderr: | 20221212192939594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192939594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192939595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192939595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192939595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192939596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192939596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:41.019267 run osmo-stp_10.42.42.5(pid=19185): stdout: | (launched: 2022-12-12_19:29:39.422345) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:41.140020 run osmo-stp_10.42.42.5(pid=19185): stderr: | 20221212192939594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192939594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192939595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192939595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192939595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192939596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192939596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:41.285709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19185): Process ended prematurely: osmo-stp_10.42.42.5(pid=19185) [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19185)] [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:29:41.294544 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:29:41.320861 run osmo-hlr_10.42.42.2(pid=19182): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19182)] 19:29:41.368611 run osmo-hlr_10.42.42.2(pid=19182): stdout: | (launched: 2022-12-12_19:29:38.473576) 19:29:41.417820 run osmo-hlr_10.42.42.2(pid=19182): stderr: | 20221212192938648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192938648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192938648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192938648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192938648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192938648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192938661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192938669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192938669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192938669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:41.486663 run osmo-msc_10.42.42.6(pid=19188): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19188)] 19:29:41.534119 run osmo-msc_10.42.42.6(pid=19188): stdout: | (launched: 2022-12-12_19:29:40.408654) 19:29:41.583469 run osmo-msc_10.42.42.6(pid=19188): stderr: | 20221212192940682 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192940682 DLGLOBAL DEBUG validating counter group 0x7faa06bf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192940682 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192940682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192940683 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192940683 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192940685 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192940685 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192940685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192940685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:29:41.633081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19181): Terminating (SIGTERM) 19:29:41.672540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19184): Terminating (SIGTERM) 19:29:41.712051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19187): Terminating (SIGTERM) 19:29:41.751809 --- ParallelTerminationStrategy: PID 19181 died... 19:29:41.771045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19181): Terminated: ok {rc=0} 19:29:41.815139 --- ParallelTerminationStrategy: PID 19184 died... 19:29:41.833997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19184): Terminated: ok {rc=0} 19:29:41.877788 --- ParallelTerminationStrategy: PID 19187 died... 19:29:41.896591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19187): Terminated: ok {rc=0} 19:29:41.979788 bus /sierra_3: Setting Powered False 19:29:43.075503 bus /sierra_3: Setting Powered False 19:29:44.190337 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:29:45.343207 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:45.355577 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:29:45.428072 tst mo_mt_call_osmux.py: using LAC 30997 19:29:45.557412 tst mo_mt_call_osmux.py: using RAC 142 19:29:45.689727 tst mo_mt_call_osmux.py: using CellId 30997 19:29:45.817859 tst mo_mt_call_osmux.py: using BVCI 30998 19:29:45.951862 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:45.964312 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:45.976380 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:45.989053 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:46.001619 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:29:46.014143 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:29:46.135073 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:29:46.273740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:46.768368 run create_hlr_db(pid=19190): Launched 19:29:46.924155 bus /sierra_2: Setting Powered False 19:29:47.986210 run create_hlr_db(pid=19190): Terminated: ok {rc=0} 19:29:48.415373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19192): Launched 19:29:48.722864 run osmo-hlr_10.42.42.2(pid=19193): Launched 19:29:48.841117 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:49.369534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19195): Launched 19:29:49.675452 run osmo-stp_10.42.42.5(pid=19196): Launched 19:29:49.791313 run osmo-msc_10.42.42.6: Starting osmo-msc 19:29:50.346426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19198): Launched 19:29:50.654972 run osmo-msc_10.42.42.6(pid=19199): Launched 19:29:50.826199 run osmo-stp_10.42.42.5(pid=19196): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19196)] 19:29:50.955532 run osmo-stp_10.42.42.5(pid=19196): stdout: | (launched: 2022-12-12_19:29:49.618862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:51.085028 run osmo-stp_10.42.42.5(pid=19196): stderr: | 20221212192949790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192949790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192949790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192949791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192949791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192949791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192949792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:51.212404 run osmo-stp_10.42.42.5(pid=19196): stdout: | (launched: 2022-12-12_19:29:49.618862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:51.334354 run osmo-stp_10.42.42.5(pid=19196): stderr: | 20221212192949790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212192949790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212192949790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212192949791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212192949791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212192949791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212192949792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:51.479956 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19196): Process ended prematurely: osmo-stp_10.42.42.5(pid=19196) [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19196)] [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:29:51.488920 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:29:51.515415 run osmo-hlr_10.42.42.2(pid=19193): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19193)] 19:29:51.563258 run osmo-hlr_10.42.42.2(pid=19193): stdout: | (launched: 2022-12-12_19:29:48.666038) 19:29:51.613177 run osmo-hlr_10.42.42.2(pid=19193): stderr: | 20221212192948845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192948845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192948845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192948845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192948845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192948845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192948858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192948867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192948867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192948867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:51.682693 run osmo-msc_10.42.42.6(pid=19199): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19199)] 19:29:51.730644 run osmo-msc_10.42.42.6(pid=19199): stdout: | (launched: 2022-12-12_19:29:50.597490) 19:29:51.780170 run osmo-msc_10.42.42.6(pid=19199): stderr: | 20221212192950873 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212192950873 DLGLOBAL DEBUG validating counter group 0x7f27d278dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212192950873 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212192950873 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212192950874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212192950874 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212192950875 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212192950876 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212192950876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212192950876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:29:51.829941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19192): Terminating (SIGTERM) 19:29:51.869545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19195): Terminating (SIGTERM) 19:29:51.909427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19198): Terminating (SIGTERM) 19:29:51.949527 --- ParallelTerminationStrategy: PID 19192 died... 19:29:51.968682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19192): Terminated: ok {rc=0} 19:29:52.012601 --- ParallelTerminationStrategy: PID 19195 died... 19:29:52.031180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19195): Terminated: ok {rc=0} 19:29:52.075009 --- ParallelTerminationStrategy: PID 19198 died... 19:29:52.093577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19198): Terminated: ok {rc=0} 19:29:52.177621 bus /sierra_3: Setting Powered False 19:29:53.276071 bus /sierra_3: Setting Powered False 19:29:54.394587 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:29:55.646069 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:29:55.652606 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:29:55.687905 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:29:55.715481 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:29:55.769355 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:29:55.803647 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:29:55.831242 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:29:56.381639 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:29:56.434674 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:29:56.446178 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:29:56.518435 tst mo_mt_call.py: using LAC 30998 19:29:56.648008 tst mo_mt_call.py: using RAC 143 19:29:56.778792 tst mo_mt_call.py: using CellId 30998 19:29:56.906995 tst mo_mt_call.py: using BVCI 30999 19:29:57.025805 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:29:57.037279 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:29:57.048481 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:29:57.060035 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:29:57.071348 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:29:57.082846 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:29:57.199451 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:29:57.316219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:57.794582 run create_hlr_db(pid=19204): Launched 19:29:57.921600 bus /sierra_2: Setting Powered False 19:29:58.982462 run create_hlr_db(pid=19204): Terminated: ok {rc=0} 19:29:59.433053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Launched 19:29:59.764227 run osmo-hlr_10.42.42.2(pid=19207): Launched 19:29:59.890095 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:00.459331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Launched 19:30:00.789661 run osmo-stp_10.42.42.5(pid=19210): Launched 19:30:01.008074 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:01.725660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19215): Launched 19:30:02.056685 run osmo-msc_10.42.42.6(pid=19216): Launched 19:30:02.417720 run osmo-stp_10.42.42.5(pid=19210): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] 19:30:02.567582 run osmo-stp_10.42.42.5(pid=19210): stdout: | (launched: 2022-12-12_19:30:00.728583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:02.707959 run osmo-stp_10.42.42.5(pid=19210): stderr: | 20221212193001016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193001019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193001020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193001020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193001021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193001021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193001021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:02.845692 run osmo-stp_10.42.42.5(pid=19210): stdout: | (launched: 2022-12-12_19:30:00.728583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:02.976415 run osmo-stp_10.42.42.5(pid=19210): stderr: | 20221212193001016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193001019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193001020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193001020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193001021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193001021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193001021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:03.133035 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19210): Process ended prematurely: osmo-stp_10.42.42.5(pid=19210) [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:30:03.142544 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:30:03.170999 run osmo-hlr_10.42.42.2(pid=19207): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19207)] 19:30:03.222656 run osmo-hlr_10.42.42.2(pid=19207): stdout: | (launched: 2022-12-12_19:29:59.703279) 19:30:03.276048 run osmo-hlr_10.42.42.2(pid=19207): stderr: | 20221212192959906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212192959906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212192959906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212192959906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212192959906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212192959906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212192959918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212192959926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212192959926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212192959926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:03.349765 run osmo-msc_10.42.42.6(pid=19216): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19216)] 19:30:03.400932 run osmo-msc_10.42.42.6(pid=19216): stdout: | (launched: 2022-12-12_19:30:01.998692) 19:30:03.453801 run osmo-msc_10.42.42.6(pid=19216): stderr: | 20221212193002507 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193002507 DLGLOBAL DEBUG validating counter group 0x7f6dca84bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193002507 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193002507 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193002507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193002508 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193002509 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193002510 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193002510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193002510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:03.507135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Terminating (SIGTERM) 19:30:03.549977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Terminating (SIGTERM) 19:30:03.592691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19215): Terminating (SIGTERM) 19:30:03.636129 --- ParallelTerminationStrategy: PID 19206 died... 19:30:03.656426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Terminated: ok {rc=0} 19:30:03.703891 --- ParallelTerminationStrategy: PID 19209 died... 19:30:03.724058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Terminated: ok {rc=0} 19:30:03.771555 --- ParallelTerminationStrategy: PID 19215 died... 19:30:03.791536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19215): Terminated: ok {rc=0} 19:30:03.881249 bus /sierra_3: Setting Powered False 19:30:04.984147 bus /sierra_3: Setting Powered False 19:30:06.102435 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:30:07.254140 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:30:07.266319 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:30:07.339712 tst mo_mt_call_osmux.py: using LAC 30999 19:30:07.470016 tst mo_mt_call_osmux.py: using RAC 144 19:30:07.598485 tst mo_mt_call_osmux.py: using CellId 30999 19:30:07.727184 tst mo_mt_call_osmux.py: using BVCI 31000 19:30:07.848392 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:30:07.859996 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:30:07.871304 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:30:07.882967 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:30:07.894528 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:30:07.906151 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:30:08.022752 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:30:08.142849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:08.652583 run create_hlr_db(pid=19218): Launched 19:30:08.779258 bus /sierra_2: Setting Powered False 19:30:09.844484 run create_hlr_db(pid=19218): Terminated: ok {rc=0} 19:30:10.285491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19220): Launched 19:30:10.594036 run osmo-hlr_10.42.42.2(pid=19221): Launched 19:30:10.710454 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:11.253261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19223): Launched 19:30:11.560908 run osmo-stp_10.42.42.5(pid=19224): Launched 19:30:11.679004 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:12.234579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19226): Launched 19:30:12.542151 run osmo-msc_10.42.42.6(pid=19227): Launched 19:30:12.714638 run osmo-stp_10.42.42.5(pid=19224): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19224)] 19:30:12.843986 run osmo-stp_10.42.42.5(pid=19224): stdout: | (launched: 2022-12-12_19:30:11.503907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:12.973211 run osmo-stp_10.42.42.5(pid=19224): stderr: | 20221212193011675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193011675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193011675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193011676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193011676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193011676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193011676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:13.100332 run osmo-stp_10.42.42.5(pid=19224): stdout: | (launched: 2022-12-12_19:30:11.503907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:13.222426 run osmo-stp_10.42.42.5(pid=19224): stderr: | 20221212193011675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193011675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193011675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193011676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193011676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193011676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193011676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:13.368063 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19224): Process ended prematurely: osmo-stp_10.42.42.5(pid=19224) [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19224)] [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:30:13.377018 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:30:13.403588 run osmo-hlr_10.42.42.2(pid=19221): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19221)] 19:30:13.451946 run osmo-hlr_10.42.42.2(pid=19221): stdout: | (launched: 2022-12-12_19:30:10.536696) 19:30:13.502465 run osmo-hlr_10.42.42.2(pid=19221): stderr: | 20221212193010713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193010713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193010713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193010713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193010713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193010714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193010726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193010737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193010737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193010737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:13.572017 run osmo-msc_10.42.42.6(pid=19227): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19227)] 19:30:13.620022 run osmo-msc_10.42.42.6(pid=19227): stdout: | (launched: 2022-12-12_19:30:12.484625) 19:30:13.669833 run osmo-msc_10.42.42.6(pid=19227): stderr: | 20221212193012758 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193012758 DLGLOBAL DEBUG validating counter group 0x7ff6c7f92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193012758 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193012758 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193012758 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193012758 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193012760 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193012760 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193012761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193012761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:13.720038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19220): Terminating (SIGTERM) 19:30:13.760344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19223): Terminating (SIGTERM) 19:30:13.800290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19226): Terminating (SIGTERM) 19:30:13.840597 --- ParallelTerminationStrategy: PID 19220 died... 19:30:13.859860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19220): Terminated: ok {rc=0} 19:30:13.904182 --- ParallelTerminationStrategy: PID 19223 died... 19:30:13.922847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19223): Terminated: ok {rc=0} 19:30:13.966896 --- ParallelTerminationStrategy: PID 19226 died... 19:30:13.985903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19226): Terminated: ok {rc=0} 19:30:14.072507 bus /sierra_3: Setting Powered False 19:30:15.173668 bus /sierra_3: Setting Powered False 19:30:16.294951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 19:30:17.558393 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:17.563271 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 19:30:17.596187 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 19:30:17.622641 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 19:30:17.675285 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 19:30:17.708084 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 19:30:17.734317 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 19:30:18.283166 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 19:30:18.332119 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:18.343056 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 19:30:18.393193 tst mo_mt_call.py: using LAC 31000 19:30:18.514051 tst mo_mt_call.py: using RAC 145 19:30:18.633784 tst mo_mt_call.py: using CellId 31000 19:30:18.753456 tst mo_mt_call.py: using BVCI 31001 19:30:18.864041 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:18.875134 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:18.886093 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:18.896843 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:18.907707 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:18.918661 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 19:30:19.037493 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 19:30:19.154045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:19.630804 run create_hlr_db(pid=19232): Launched 19:30:19.756880 bus /sierra_2: Setting Powered False 19:30:20.817945 run create_hlr_db(pid=19232): Terminated: ok {rc=0} 19:30:21.266726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19234): Launched 19:30:21.597068 run osmo-hlr_10.42.42.2(pid=19235): Launched 19:30:21.724221 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:22.286888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19237): Launched 19:30:22.615641 run osmo-stp_10.42.42.5(pid=19238): Launched 19:30:22.741477 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:23.334757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19240): Launched 19:30:23.663676 run osmo-msc_10.42.42.6(pid=19241): Launched 19:30:23.851269 run osmo-stp_10.42.42.5(pid=19238): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19238)] 19:30:23.989695 run osmo-stp_10.42.42.5(pid=19238): stdout: | (launched: 2022-12-12_19:30:22.555527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:24.128467 run osmo-stp_10.42.42.5(pid=19238): stderr: | 20221212193022747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193022747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193022748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193022748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193022748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193022749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193022749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:24.265283 run osmo-stp_10.42.42.5(pid=19238): stdout: | (launched: 2022-12-12_19:30:22.555527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:24.395204 run osmo-stp_10.42.42.5(pid=19238): stderr: | 20221212193022747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193022747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193022748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193022748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193022748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193022749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193022749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:24.551017 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19238): Process ended prematurely: osmo-stp_10.42.42.5(pid=19238) [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19238)] [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 19:30:24.560514 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:30:24.589123 run osmo-hlr_10.42.42.2(pid=19235): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19235)] 19:30:24.640037 run osmo-hlr_10.42.42.2(pid=19235): stdout: | (launched: 2022-12-12_19:30:21.536622) 19:30:24.692560 run osmo-hlr_10.42.42.2(pid=19235): stderr: | 20221212193021737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193021737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193021737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193021737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193021737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193021737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193021753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193021762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193021763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193021763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:24.765996 run osmo-msc_10.42.42.6(pid=19241): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19241)] 19:30:24.816762 run osmo-msc_10.42.42.6(pid=19241): stdout: | (launched: 2022-12-12_19:30:23.602623) 19:30:24.869185 run osmo-msc_10.42.42.6(pid=19241): stderr: | 20221212193023924 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193023924 DLGLOBAL DEBUG validating counter group 0x7f93c7071c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193023924 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193023925 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193023925 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193023925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193023927 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193023927 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193023927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193023927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:24.921826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19234): Terminating (SIGTERM) 19:30:24.964543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19237): Terminating (SIGTERM) 19:30:25.007229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19240): Terminating (SIGTERM) 19:30:25.050052 --- ParallelTerminationStrategy: PID 19234 died... 19:30:25.070563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19234): Terminated: ok {rc=0} 19:30:25.118141 --- ParallelTerminationStrategy: PID 19237 died... 19:30:25.137926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19237): Terminated: ok {rc=0} 19:30:25.185182 --- ParallelTerminationStrategy: PID 19240 died... 19:30:25.204859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19240): Terminated: ok {rc=0} 19:30:25.294725 bus /sierra_3: Setting Powered False 19:30:26.396319 bus /sierra_3: Setting Powered False 19:30:27.514586 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 19:30:28.666659 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:28.678924 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 19:30:28.732460 tst mo_mt_call_osmux.py: using LAC 31001 19:30:28.861662 tst mo_mt_call_osmux.py: using RAC 146 19:30:28.988937 tst mo_mt_call_osmux.py: using CellId 31001 19:30:29.116105 tst mo_mt_call_osmux.py: using BVCI 31002 19:30:29.234382 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:29.245974 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:29.257314 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:29.268824 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:29.280417 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 19:30:29.292051 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 19:30:29.409143 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 19:30:29.527801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:30.039232 run create_hlr_db(pid=19243): Launched 19:30:30.165562 bus /sierra_2: Setting Powered False 19:30:31.230246 run create_hlr_db(pid=19243): Terminated: ok {rc=0} 19:30:31.697426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Launched 19:30:32.040824 run osmo-hlr_10.42.42.2(pid=19247): Launched 19:30:32.212855 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:32.743382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Launched 19:30:33.050202 run osmo-stp_10.42.42.5(pid=19250): Launched 19:30:33.169597 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:33.723906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19252): Launched 19:30:34.030792 run osmo-msc_10.42.42.6(pid=19253): Launched 19:30:34.203681 run osmo-stp_10.42.42.5(pid=19250): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] 19:30:34.332168 run osmo-stp_10.42.42.5(pid=19250): stdout: | (launched: 2022-12-12_19:30:32.993407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:34.463109 run osmo-stp_10.42.42.5(pid=19250): stderr: | 20221212193033165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193033165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193033165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193033166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193033166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193033166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193033166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:34.590146 run osmo-stp_10.42.42.5(pid=19250): stdout: | (launched: 2022-12-12_19:30:32.993407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:34.711598 run osmo-stp_10.42.42.5(pid=19250): stderr: | 20221212193033165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193033165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193033165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193033166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193033166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193033166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193033166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:34.856440 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19250): Process ended prematurely: osmo-stp_10.42.42.5(pid=19250) [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 19:30:34.865403 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:30:34.891734 run osmo-hlr_10.42.42.2(pid=19247): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19247)] 19:30:34.940026 run osmo-hlr_10.42.42.2(pid=19247): stdout: | (launched: 2022-12-12_19:30:31.980278) 19:30:34.989809 run osmo-hlr_10.42.42.2(pid=19247): stderr: | 20221212193032218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193032218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193032218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193032218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193032218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193032218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193032230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193032241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193032241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193032241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:35.059005 run osmo-msc_10.42.42.6(pid=19253): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19253)] 19:30:35.107129 run osmo-msc_10.42.42.6(pid=19253): stdout: | (launched: 2022-12-12_19:30:33.973969) 19:30:35.157183 run osmo-msc_10.42.42.6(pid=19253): stderr: | 20221212193034247 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193034247 DLGLOBAL DEBUG validating counter group 0x7fe28e931c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193034247 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193034247 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193034247 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193034248 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193034249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193034250 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193034250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193034250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:35.207415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Terminating (SIGTERM) 19:30:35.246885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Terminating (SIGTERM) 19:30:35.286472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19252): Terminating (SIGTERM) 19:30:35.326517 --- ParallelTerminationStrategy: PID 19246 died... 19:30:35.345658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Terminated: ok {rc=0} 19:30:35.389887 --- ParallelTerminationStrategy: PID 19249 died... 19:30:35.408481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Terminated: ok {rc=0} 19:30:35.452513 --- ParallelTerminationStrategy: PID 19252 died... 19:30:35.471180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19252): Terminated: ok {rc=0} 19:30:35.557039 bus /sierra_3: Setting Powered False 19:30:36.658060 bus /sierra_3: Setting Powered False 19:30:37.774974 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:30:39.023252 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:39.029296 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:30:39.062316 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 19:30:39.088750 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 19:30:39.141472 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:30:39.174910 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 19:30:39.201364 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 19:30:39.753091 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 19:30:39.802291 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:39.813641 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:30:39.865640 tst mo_mt_call.py: using LAC 31002 19:30:39.984636 tst mo_mt_call.py: using RAC 147 19:30:40.105068 tst mo_mt_call.py: using CellId 31002 19:30:40.229605 tst mo_mt_call.py: using BVCI 31003 19:30:40.340778 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:40.352146 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:40.363288 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:40.374450 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:40.385601 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:40.396654 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:30:40.516703 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:30:40.639771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:41.150227 run create_hlr_db(pid=19258): Launched 19:30:41.277472 bus /sierra_2: Setting Powered False 19:30:42.342859 run create_hlr_db(pid=19258): Terminated: ok {rc=0} 19:30:42.781754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19260): Launched 19:30:43.087306 run osmo-hlr_10.42.42.2(pid=19261): Launched 19:30:43.205842 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:43.747008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19263): Launched 19:30:44.054001 run osmo-stp_10.42.42.5(pid=19264): Launched 19:30:44.171240 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:44.724374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19266): Launched 19:30:45.031247 run osmo-msc_10.42.42.6(pid=19267): Launched 19:30:45.203054 run osmo-stp_10.42.42.5(pid=19264): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19264)] 19:30:45.332264 run osmo-stp_10.42.42.5(pid=19264): stdout: | (launched: 2022-12-12_19:30:43.997209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:45.461973 run osmo-stp_10.42.42.5(pid=19264): stderr: | 20221212193044168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193044169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193044169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193044169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193044170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193044170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193044170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:45.589590 run osmo-stp_10.42.42.5(pid=19264): stdout: | (launched: 2022-12-12_19:30:43.997209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:45.711886 run osmo-stp_10.42.42.5(pid=19264): stderr: | 20221212193044168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193044169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193044169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193044169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193044170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193044170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193044170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:45.871757 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19264): Process ended prematurely: osmo-stp_10.42.42.5(pid=19264) [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19264)] [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 19:30:45.887800 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:30:45.929119 run osmo-hlr_10.42.42.2(pid=19261): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19261)] 19:30:45.978140 run osmo-hlr_10.42.42.2(pid=19261): stdout: | (launched: 2022-12-12_19:30:43.030749) 19:30:46.044546 run osmo-hlr_10.42.42.2(pid=19261): stderr: | 20221212193043205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193043205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193043205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193043206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193043206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193043206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193043218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193043226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193043226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193043226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:46.121552 run osmo-msc_10.42.42.6(pid=19267): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19267)] 19:30:46.177695 run osmo-msc_10.42.42.6(pid=19267): stdout: | (launched: 2022-12-12_19:30:44.974338) 19:30:46.243283 run osmo-msc_10.42.42.6(pid=19267): stderr: | 20221212193045249 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193045249 DLGLOBAL DEBUG validating counter group 0x7f29e8682c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193045249 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193045249 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193045249 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193045250 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193045251 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193045252 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193045252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193045252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:46.305352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19260): Terminating (SIGTERM) 19:30:46.352665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19263): Terminating (SIGTERM) 19:30:46.403843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19266): Terminating (SIGTERM) 19:30:46.457303 --- ParallelTerminationStrategy: PID 19260 died... 19:30:46.481176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19260): Terminated: ok {rc=0} 19:30:46.537160 --- ParallelTerminationStrategy: PID 19263 died... 19:30:46.558883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19263): Terminated: ok {rc=0} 19:30:46.615320 --- ParallelTerminationStrategy: PID 19266 died... 19:30:46.640021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19266): Terminated: ok {rc=0} 19:30:46.744900 bus /sierra_3: Setting Powered False 19:30:47.850657 bus /sierra_3: Setting Powered False 19:30:48.967314 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 19:30:50.115416 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:50.127677 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:30:50.180926 tst mo_mt_call_osmux.py: using LAC 31003 19:30:50.302502 tst mo_mt_call_osmux.py: using RAC 148 19:30:50.427765 tst mo_mt_call_osmux.py: using CellId 31003 19:30:50.557110 tst mo_mt_call_osmux.py: using BVCI 31004 19:30:50.675981 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:50.688144 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:50.700170 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:50.712413 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:50.725280 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:30:50.737975 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:30:50.860192 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:30:50.983269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:51.458359 run create_hlr_db(pid=19269): Launched 19:30:51.583760 bus /sierra_2: Setting Powered False 19:30:52.645590 run create_hlr_db(pid=19269): Terminated: ok {rc=0} 19:30:53.094606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19271): Launched 19:30:53.422683 run osmo-hlr_10.42.42.2(pid=19272): Launched 19:30:53.547889 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:54.114925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19274): Launched 19:30:54.441858 run osmo-stp_10.42.42.5(pid=19275): Launched 19:30:54.568357 run osmo-msc_10.42.42.6: Starting osmo-msc 19:30:55.161208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19277): Launched 19:30:55.487651 run osmo-msc_10.42.42.6(pid=19278): Launched 19:30:55.672032 run osmo-stp_10.42.42.5(pid=19275): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19275)] 19:30:55.811008 run osmo-stp_10.42.42.5(pid=19275): stdout: | (launched: 2022-12-12_19:30:54.381694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:55.949071 run osmo-stp_10.42.42.5(pid=19275): stderr: | 20221212193054575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193054575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193054575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193054575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193054576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193054576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193054576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:56.086047 run osmo-stp_10.42.42.5(pid=19275): stdout: | (launched: 2022-12-12_19:30:54.381694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:56.216238 run osmo-stp_10.42.42.5(pid=19275): stderr: | 20221212193054575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193054575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193054575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193054575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193054576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193054576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193054576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:56.372320 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19275): Process ended prematurely: osmo-stp_10.42.42.5(pid=19275) [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19275)] [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 19:30:56.382225 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:30:56.410447 run osmo-hlr_10.42.42.2(pid=19272): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19272)] 19:30:56.461841 run osmo-hlr_10.42.42.2(pid=19272): stdout: | (launched: 2022-12-12_19:30:53.362684) 19:30:56.514455 run osmo-hlr_10.42.42.2(pid=19272): stderr: | 20221212193053562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193053562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193053562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193053562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193053562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193053562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193053574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193053582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193053582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193053583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:56.587844 run osmo-msc_10.42.42.6(pid=19278): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19278)] 19:30:56.638589 run osmo-msc_10.42.42.6(pid=19278): stdout: | (launched: 2022-12-12_19:30:55.427461) 19:30:56.691074 run osmo-msc_10.42.42.6(pid=19278): stderr: | 20221212193055751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193055751 DLGLOBAL DEBUG validating counter group 0x7f51413a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193055751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193055751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193055752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193055752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193055753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193055754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193055754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193055754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:30:56.743861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19271): Terminating (SIGTERM) 19:30:56.786654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19274): Terminating (SIGTERM) 19:30:56.829196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19277): Terminating (SIGTERM) 19:30:56.871914 --- ParallelTerminationStrategy: PID 19271 died... 19:30:56.892171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19271): Terminated: ok {rc=0} 19:30:56.939180 --- ParallelTerminationStrategy: PID 19274 died... 19:30:56.958890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19274): Terminated: ok {rc=0} 19:30:57.005767 --- ParallelTerminationStrategy: PID 19277 died... 19:30:57.025231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19277): Terminated: ok {rc=0} 19:30:57.115090 bus /sierra_3: Setting Powered False 19:30:58.215725 bus /sierra_3: Setting Powered False 19:30:59.334424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:trx-b200 --------------------------------------------------------------------- 19:31:00.585684 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:00.590352 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 19:31:00.623050 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 19:31:00.649490 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 19:31:00.733777 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 19:31:00.766047 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 19:31:00.792098 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 19:31:01.420532 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 19:31:01.429972 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:01.445698 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 19:31:01.518074 tst emergency_mo_mt_call.py: using LAC 31004 19:31:01.638112 tst emergency_mo_mt_call.py: using RAC 149 19:31:01.756772 tst emergency_mo_mt_call.py: using CellId 31004 19:31:01.885386 tst emergency_mo_mt_call.py: using BVCI 31005 19:31:02.005597 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:02.017327 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:02.028799 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:02.041340 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:02.054440 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:02.067272 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:31:02.211950 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:31:02.339286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:02.806978 run create_hlr_db(pid=19284): Launched 19:31:02.929042 bus /sierra_2: Setting Powered False 19:31:03.989277 run create_hlr_db(pid=19284): Terminated: ok {rc=0} 19:31:04.406547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Launched 19:31:04.703972 run osmo-hlr_10.42.42.2(pid=19287): Launched 19:31:04.816254 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:05.328584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Launched 19:31:05.626625 run osmo-stp_10.42.42.5(pid=19290): Launched 19:31:05.750630 tst emergency_mo_mt_call.py: using MSISDN 7934 19:31:05.902368 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:06.439270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19292): Launched 19:31:06.738028 run osmo-msc_10.42.42.6(pid=19293): Launched 19:31:06.904370 run osmo-stp_10.42.42.5(pid=19290): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] 19:31:07.029510 run osmo-stp_10.42.42.5(pid=19290): stdout: | (launched: 2022-12-12_19:31:05.571106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:07.155583 run osmo-stp_10.42.42.5(pid=19290): stderr: | 20221212193105742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193105742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193105742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193105742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193105743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193105743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193105743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:07.279151 run osmo-stp_10.42.42.5(pid=19290): stdout: | (launched: 2022-12-12_19:31:05.571106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:07.397726 run osmo-stp_10.42.42.5(pid=19290): stderr: | 20221212193105742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193105742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193105742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193105742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193105743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193105743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193105743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:07.538976 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19290): Process ended prematurely: osmo-stp_10.42.42.5(pid=19290) [trial-2381↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] [trial-2381↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 19:31:07.547257 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 19:31:07.573324 run osmo-hlr_10.42.42.2(pid=19287): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19287)] 19:31:07.621077 run osmo-hlr_10.42.42.2(pid=19287): stdout: | (launched: 2022-12-12_19:31:04.648439) 19:31:07.670715 run osmo-hlr_10.42.42.2(pid=19287): stderr: | 20221212193104826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193104826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193104826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193104826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193104826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193104826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193104841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193104849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193104849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193104849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:07.740041 run osmo-msc_10.42.42.6(pid=19293): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19293)] 19:31:07.787756 run osmo-msc_10.42.42.6(pid=19293): stdout: | (launched: 2022-12-12_19:31:06.682215) 19:31:07.837422 run osmo-msc_10.42.42.6(pid=19293): stderr: | 20221212193106955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193106956 DLGLOBAL DEBUG validating counter group 0x7f3818ec2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193106956 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193106956 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193106957 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193106957 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193106959 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193106960 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193106960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193106960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:07.887367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Terminating (SIGTERM) 19:31:07.927577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Terminating (SIGTERM) 19:31:07.967510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19292): Terminating (SIGTERM) 19:31:08.007712 --- ParallelTerminationStrategy: PID 19286 died... 19:31:08.027025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Terminated: ok {rc=0} 19:31:08.071182 --- ParallelTerminationStrategy: PID 19289 died... 19:31:08.089901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Terminated: ok {rc=0} 19:31:08.133682 --- ParallelTerminationStrategy: PID 19292 died... 19:31:08.152455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19292): Terminated: ok {rc=0} 19:31:08.236556 bus /sierra_3: Setting Powered False 19:31:09.333805 bus /sierra_3: Setting Powered False 19:31:10.448549 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 19:31:11.536453 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:11.547826 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 19:31:11.598803 tst emergency_preemptive_call.py: using LAC 31005 19:31:11.715666 tst emergency_preemptive_call.py: using RAC 150 19:31:11.830251 tst emergency_preemptive_call.py: using CellId 31005 19:31:11.944261 tst emergency_preemptive_call.py: using BVCI 31006 19:31:12.050487 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:12.061297 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:12.071681 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:12.082672 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:12.093687 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:31:12.104608 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:31:12.223278 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:31:12.338365 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:31:12.454965 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:31:12.567251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:13.059342 run create_hlr_db(pid=19295): Launched 19:31:13.179627 bus /sierra_2: Setting Powered False 19:31:14.242856 run create_hlr_db(pid=19295): Terminated: ok {rc=0} 19:31:14.664590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19297): Launched 19:31:14.958438 run osmo-hlr_10.42.42.2(pid=19298): Launched 19:31:15.069465 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:15.572441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19300): Launched 19:31:15.873815 run osmo-stp_10.42.42.5(pid=19301): Launched 19:31:16.119077 tst emergency_preemptive_call.py: using MSISDN 7935 19:31:16.358873 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:16.942598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19303): Launched 19:31:17.349735 run osmo-msc_10.42.42.6(pid=19304): Launched 19:31:17.549979 run osmo-stp_10.42.42.5(pid=19301): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19301)] 19:31:17.674921 run osmo-stp_10.42.42.5(pid=19301): stdout: | (launched: 2022-12-12_19:31:15.811152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:17.799271 run osmo-stp_10.42.42.5(pid=19301): stderr: | 20221212193116087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193116087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193116087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193116087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193116088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193116088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193116088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:17.920877 run osmo-stp_10.42.42.5(pid=19301): stdout: | (launched: 2022-12-12_19:31:15.811152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:18.037939 run osmo-stp_10.42.42.5(pid=19301): stderr: | 20221212193116087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193116087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193116087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193116087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193116088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193116088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193116088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:18.176791 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19301): Process ended prematurely: osmo-stp_10.42.42.5(pid=19301) [trial-2381↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19301)] [trial-2381↪emergency:trx-b200↪emergency_preemptive_call.py:32] 19:31:18.184932 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 19:31:18.211067 run osmo-hlr_10.42.42.2(pid=19298): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19298)] 19:31:18.259001 run osmo-hlr_10.42.42.2(pid=19298): stdout: | (launched: 2022-12-12_19:31:14.904443) 19:31:18.308478 run osmo-hlr_10.42.42.2(pid=19298): stderr: | 20221212193115074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193115074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193115074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193115074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193115074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193115074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193115087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193115096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193115096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193115096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:18.377831 run osmo-msc_10.42.42.6(pid=19304): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19304)] 19:31:18.425524 run osmo-msc_10.42.42.6(pid=19304): stdout: | (launched: 2022-12-12_19:31:17.283137) 19:31:18.474867 run osmo-msc_10.42.42.6(pid=19304): stderr: | 20221212193117641 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193117641 DLGLOBAL DEBUG validating counter group 0x7fbb996b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193117642 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193117642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193117642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193117642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193117644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193117644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193117644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193117644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:18.524417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19297): Terminating (SIGTERM) 19:31:18.563836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19300): Terminating (SIGTERM) 19:31:18.603378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19303): Terminating (SIGTERM) 19:31:18.643218 --- ParallelTerminationStrategy: PID 19297 died... 19:31:18.662221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19297): Terminated: ok {rc=0} 19:31:18.706679 --- ParallelTerminationStrategy: PID 19300 died... 19:31:18.725302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19300): Terminated: ok {rc=0} 19:31:18.769092 --- ParallelTerminationStrategy: PID 19303 died... 19:31:18.787649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19303): Terminated: ok {rc=0} 19:31:18.874133 bus /sierra_9: Setting Powered False 19:31:19.975145 bus /sierra_9: Setting Powered False 19:31:21.092272 bus /sierra_8: Setting Powered False 19:31:22.193056 bus /sierra_8: Setting Powered False 19:31:23.309230 bus /sierra_3: Setting Powered False 19:31:24.408843 bus /sierra_3: Setting Powered False 19:31:25.526257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-b200 --------------------------------------------------------------------- 19:31:26.808421 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:26.813292 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 19:31:26.847973 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 19:31:26.887290 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 19:31:26.975409 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 19:31:27.009372 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 19:31:27.048440 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 19:31:27.637919 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 19:31:27.687354 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:27.698180 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:31:27.746513 tst cs_paging_gprs_active.py: using LAC 31006 19:31:27.864283 tst cs_paging_gprs_active.py: using RAC 151 19:31:27.986300 tst cs_paging_gprs_active.py: using CellId 31006 19:31:28.104362 tst cs_paging_gprs_active.py: using BVCI 31007 19:31:28.214471 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.225046 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.235379 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.245852 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.256209 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.266592 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.277099 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.287604 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:28.298156 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:31:28.416332 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:31:28.534464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:31:28.752427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:31:29.075274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19309): Launched 19:31:29.355303 run iperf3-srv_10.42.42.10(pid=19310): Launched 19:31:29.475836 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:31:29.692756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:31:30.015769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19311): Launched 19:31:30.296558 run iperf3-srv_10.42.42.10(pid=19312): Launched 19:31:30.417014 tst cs_paging_gprs_active.py:38: start network... 19:31:30.633161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:31.156213 run create_hlr_db(pid=19313): Launched 19:31:31.311341 bus /sierra_2: Setting Powered False 19:31:32.375768 run create_hlr_db(pid=19313): Terminated: ok {rc=0} 19:31:32.804595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19315): Launched 19:31:33.103451 run osmo-hlr_10.42.42.2(pid=19316): Launched 19:31:33.216748 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:33.729554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19318): Launched 19:31:34.027777 run osmo-stp_10.42.42.5(pid=19319): Launched 19:31:34.141668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:31:34.657295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19321): Launched 19:31:34.772370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:31:35.027166 run patchelf(pid=19322): Launched 19:31:35.194405 run osmo-stp_10.42.42.5(pid=19319): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19319)] 19:31:35.322391 run osmo-stp_10.42.42.5(pid=19319): stdout: | (launched: 2022-12-12_19:31:33.972628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:35.451883 run osmo-stp_10.42.42.5(pid=19319): stderr: | 20221212193134141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193134141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193134141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193134142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193134142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193134142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193134142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:35.581224 run osmo-stp_10.42.42.5(pid=19319): stdout: | (launched: 2022-12-12_19:31:33.972628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:35.704354 run osmo-stp_10.42.42.5(pid=19319): stderr: | 20221212193134141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193134141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193134141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193134142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193134142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193134142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193134142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:35.850438 run patchelf(pid=19322): Terminating (SIGINT) 19:31:36.018761 run patchelf(pid=19322): Terminated: ok {rc=0} 19:31:36.140924 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19319): Process ended prematurely: osmo-stp_10.42.42.5(pid=19319) [trial-2381↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19319)] [trial-2381↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 19:31:36.150320 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 19:31:36.177257 run osmo-hlr_10.42.42.2(pid=19316): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19316)] 19:31:36.224828 run osmo-hlr_10.42.42.2(pid=19316): stdout: | (launched: 2022-12-12_19:31:33.048337) 19:31:36.273798 run osmo-hlr_10.42.42.2(pid=19316): stderr: | 20221212193133221 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193133221 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193133222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193133222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193133222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193133222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193133234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193133243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193133243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193133243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:36.323269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19309): Terminating (SIGTERM) 19:31:36.362992 run iperf3-srv_10.42.42.10(pid=19310): Terminating (SIGTERM) 19:31:36.402784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19311): Terminating (SIGTERM) 19:31:36.442587 run iperf3-srv_10.42.42.10(pid=19312): Terminating (SIGTERM) 19:31:36.482436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19315): Terminating (SIGTERM) 19:31:36.522237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19318): Terminating (SIGTERM) 19:31:36.562044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19321): Terminating (SIGTERM) 19:31:36.602432 --- ParallelTerminationStrategy: PID 19309 died... 19:31:36.621606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19309): Terminated: ok {rc=0} 19:31:36.666769 --- ParallelTerminationStrategy: PID 19310 died... 19:31:36.685600 run iperf3-srv_10.42.42.10(pid=19310): Terminated {rc=256} 19:31:36.729730 --- ParallelTerminationStrategy: PID 19311 died... 19:31:36.748276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19311): Terminated: ok {rc=0} 19:31:36.791938 --- ParallelTerminationStrategy: PID 19312 died... 19:31:36.810754 run iperf3-srv_10.42.42.10(pid=19312): Terminated {rc=256} 19:31:36.854542 --- ParallelTerminationStrategy: PID 19315 died... 19:31:36.873294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19315): Terminated: ok {rc=0} 19:31:36.917144 --- ParallelTerminationStrategy: PID 19318 died... 19:31:36.935457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19318): Terminated: ok {rc=0} 19:31:36.979548 --- ParallelTerminationStrategy: PID 19321 died... 19:31:36.998419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19321): Terminated: ok {rc=0} 19:31:37.084251 bus /gobi_0: Setting Powered False 19:31:38.184479 bus /gobi_0: Setting Powered False 19:31:39.301272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200 iperf3.py ---------------------------------------------- 19:31:40.450315 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:40.461870 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:31:40.514508 tst iperf3.py: using LAC 31007 19:31:40.640291 tst iperf3.py: using RAC 152 19:31:40.764204 tst iperf3.py: using CellId 31007 19:31:40.881999 tst iperf3.py: using BVCI 31008 19:31:40.999647 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.010860 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.021724 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.032633 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.043654 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.055018 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.066271 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.077292 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:41.088383 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:31:41.205216 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:31:41.418685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:31:41.741576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19323): Launched 19:31:42.025740 run iperf3-srv_10.42.42.10(pid=19324): Launched 19:31:42.145954 tst iperf3.py:8: start network... 19:31:42.362320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:42.862041 run create_hlr_db(pid=19325): Launched 19:31:42.985089 bus /gobi_6: Setting Powered False 19:31:44.047972 run create_hlr_db(pid=19325): Terminated: ok {rc=0} 19:31:44.480277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19327): Launched 19:31:44.783627 run osmo-hlr_10.42.42.2(pid=19328): Launched 19:31:44.896913 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:45.415529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19330): Launched 19:31:45.717680 run osmo-stp_10.42.42.5(pid=19331): Launched 19:31:45.834492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:31:46.442069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19333): Launched 19:31:46.562291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:31:46.822413 run patchelf(pid=19334): Launched 19:31:47.071359 run osmo-stp_10.42.42.5(pid=19331): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19331)] 19:31:47.210987 run osmo-stp_10.42.42.5(pid=19331): stdout: | (launched: 2022-12-12_19:31:45.658894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:47.340907 run osmo-stp_10.42.42.5(pid=19331): stderr: | 20221212193145842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193145842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193145854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193145854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193145855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193145855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193145855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:47.470217 run osmo-stp_10.42.42.5(pid=19331): stdout: | (launched: 2022-12-12_19:31:45.658894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:47.592351 run osmo-stp_10.42.42.5(pid=19331): stderr: | 20221212193145842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193145842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193145854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193145854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193145855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193145855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193145855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:47.737830 run patchelf(pid=19334): Terminating (SIGINT) 19:31:47.905560 run patchelf(pid=19334): Terminated: ok {rc=0} 19:31:48.026383 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19331): Process ended prematurely: osmo-stp_10.42.42.5(pid=19331) [trial-2381↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19331)] [trial-2381↪gprs:trx-b200↪iperf3.py:8] 19:31:48.035729 tst iperf3.py:8: Test FAILED (7.6 sec) 19:31:48.062722 run osmo-hlr_10.42.42.2(pid=19328): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19328)] 19:31:48.110259 run osmo-hlr_10.42.42.2(pid=19328): stdout: | (launched: 2022-12-12_19:31:44.724451) 19:31:48.159548 run osmo-hlr_10.42.42.2(pid=19328): stderr: | 20221212193144903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193144903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193144903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193144903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193144903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193144903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193144916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193144926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193144926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193144926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:48.209515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19323): Terminating (SIGTERM) 19:31:48.249545 run iperf3-srv_10.42.42.10(pid=19324): Terminating (SIGTERM) 19:31:48.289113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19327): Terminating (SIGTERM) 19:31:48.328756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19330): Terminating (SIGTERM) 19:31:48.368299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19333): Terminating (SIGTERM) 19:31:48.408139 --- ParallelTerminationStrategy: PID 19323 died... 19:31:48.427347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19323): Terminated: ok {rc=0} 19:31:48.471148 --- ParallelTerminationStrategy: PID 19324 died... 19:31:48.489567 run iperf3-srv_10.42.42.10(pid=19324): Terminated {rc=256} 19:31:48.532915 --- ParallelTerminationStrategy: PID 19327 died... 19:31:48.551272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19327): Terminated: ok {rc=0} 19:31:48.594689 --- ParallelTerminationStrategy: PID 19330 died... 19:31:48.613169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19330): Terminated: ok {rc=0} 19:31:48.657282 --- ParallelTerminationStrategy: PID 19333 died... 19:31:48.675722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19333): Terminated: ok {rc=0} 19:31:48.760464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 19:31:49.906776 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:49.920929 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:31:49.968296 tst iperf3m4.py: using LAC 31008 19:31:50.088152 tst iperf3m4.py: using RAC 153 19:31:50.207360 tst iperf3m4.py: using CellId 31008 19:31:50.326562 tst iperf3m4.py: using BVCI 31009 19:31:50.436539 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.447299 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.457690 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.467986 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.478295 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.488568 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.499118 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.509525 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:31:50.519927 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:31:50.633761 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:31:50.758096 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:31:50.873824 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:31:50.993150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:31:51.194768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:31:51.501961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19336): Launched 19:31:51.766745 run iperf3-srv_10.42.42.10(pid=19337): Launched 19:31:51.881464 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:31:52.081955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:31:52.388451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Launched 19:31:52.652634 run iperf3-srv_10.42.42.10(pid=19339): Launched 19:31:52.766026 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:31:52.965647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:31:53.269835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Launched 19:31:53.533558 run iperf3-srv_10.42.42.10(pid=19341): Launched 19:31:53.645171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:31:53.844587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:31:54.149135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19342): Launched 19:31:54.413064 run iperf3-srv_10.42.42.10(pid=19343): Launched 19:31:54.524682 tst iperf3m4.py:8: start network... 19:31:54.723887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:55.190695 run create_hlr_db(pid=19344): Launched 19:31:55.313386 bus /gobi_6: Setting Powered False 19:31:56.373715 run create_hlr_db(pid=19344): Terminated: ok {rc=0} 19:31:56.796841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19346): Launched 19:31:57.099016 run osmo-hlr_10.42.42.2(pid=19347): Launched 19:31:57.212251 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:57.748807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19349): Launched 19:31:58.051664 run osmo-stp_10.42.42.5(pid=19350): Launched 19:31:58.164817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:31:58.683271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19352): Launched 19:31:58.799245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:31:59.056481 run patchelf(pid=19353): Launched 19:31:59.224802 run osmo-stp_10.42.42.5(pid=19350): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19350)] 19:31:59.353484 run osmo-stp_10.42.42.5(pid=19350): stdout: | (launched: 2022-12-12_19:31:57.993124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:59.483727 run osmo-stp_10.42.42.5(pid=19350): stderr: | 20221212193158163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193158164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193158164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193158164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193158165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193158165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193158165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:59.614384 run osmo-stp_10.42.42.5(pid=19350): stdout: | (launched: 2022-12-12_19:31:57.993124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:59.738379 run osmo-stp_10.42.42.5(pid=19350): stderr: | 20221212193158163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193158164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193158164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193158164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193158165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193158165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193158165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:59.885581 run patchelf(pid=19353): Terminating (SIGINT) 19:32:00.055157 run patchelf(pid=19353): Terminated: ok {rc=0} 19:32:00.177844 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19350): Process ended prematurely: osmo-stp_10.42.42.5(pid=19350) [trial-2381↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19350)] [trial-2381↪gprs:trx-b200↪iperf3m4.py:8] 19:32:00.187273 tst iperf3m4.py:8: Test FAILED (10.3 sec) 19:32:00.214644 run osmo-hlr_10.42.42.2(pid=19347): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19347)] 19:32:00.262111 run osmo-hlr_10.42.42.2(pid=19347): stdout: | (launched: 2022-12-12_19:31:57.040547) 19:32:00.311804 run osmo-hlr_10.42.42.2(pid=19347): stderr: | 20221212193157217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193157217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193157217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193157217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193157217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193157217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193157229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193157238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193157238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193157238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:00.361829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19336): Terminating (SIGTERM) 19:32:00.401456 run iperf3-srv_10.42.42.10(pid=19337): Terminating (SIGTERM) 19:32:00.441078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Terminating (SIGTERM) 19:32:00.480785 run iperf3-srv_10.42.42.10(pid=19339): Terminating (SIGTERM) 19:32:00.520469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Terminating (SIGTERM) 19:32:00.560142 run iperf3-srv_10.42.42.10(pid=19341): Terminating (SIGTERM) 19:32:00.599685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19342): Terminating (SIGTERM) 19:32:00.639320 run iperf3-srv_10.42.42.10(pid=19343): Terminating (SIGTERM) 19:32:00.678701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19346): Terminating (SIGTERM) 19:32:00.718290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19349): Terminating (SIGTERM) 19:32:00.757935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19352): Terminating (SIGTERM) 19:32:00.797865 --- ParallelTerminationStrategy: PID 19336 died... 19:32:00.816795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19336): Terminated: ok {rc=0} 19:32:00.871548 --- ParallelTerminationStrategy: PID 19337 died... 19:32:00.890989 run iperf3-srv_10.42.42.10(pid=19337): Terminated {rc=256} 19:32:00.935372 --- ParallelTerminationStrategy: PID 19338 died... 19:32:00.954452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Terminated: ok {rc=0} 19:32:00.999398 --- ParallelTerminationStrategy: PID 19339 died... 19:32:01.018548 run iperf3-srv_10.42.42.10(pid=19339): Terminated {rc=256} 19:32:01.063359 --- ParallelTerminationStrategy: PID 19340 died... 19:32:01.082635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Terminated: ok {rc=0} 19:32:01.127622 --- ParallelTerminationStrategy: PID 19341 died... 19:32:01.146832 run iperf3-srv_10.42.42.10(pid=19341): Terminated {rc=256} 19:32:01.191443 --- ParallelTerminationStrategy: PID 19342 died... 19:32:01.210530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19342): Terminated: ok {rc=0} 19:32:01.255207 --- ParallelTerminationStrategy: PID 19343 died... 19:32:01.274441 run iperf3-srv_10.42.42.10(pid=19343): Terminated {rc=256} 19:32:01.319009 --- ParallelTerminationStrategy: PID 19346 died... 19:32:01.338215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19346): Terminated: ok {rc=0} 19:32:01.382917 --- ParallelTerminationStrategy: PID 19349 died... 19:32:01.402285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19349): Terminated: ok {rc=0} 19:32:01.447348 --- ParallelTerminationStrategy: PID 19352 died... 19:32:01.466737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19352): Terminated: ok {rc=0} 19:32:01.551343 bus /gobi_4: Setting Powered False 19:32:02.648622 bus /gobi_4: Setting Powered False 19:32:03.767304 bus /gobi_1: Setting Powered False 19:32:04.868126 bus /gobi_1: Setting Powered False 19:32:05.984728 bus /gobi_0: Setting Powered False 19:32:07.082476 bus /gobi_0: Setting Powered False 19:32:08.200808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200 ping.py ---------------------------------------------- 19:32:09.304002 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.315079 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:32:09.364207 tst ping.py: using LAC 31009 19:32:09.482089 tst ping.py: using RAC 154 19:32:09.607734 tst ping.py: using CellId 31009 19:32:09.733741 tst ping.py: using BVCI 31010 19:32:09.842622 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.853166 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.863489 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.873871 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.884111 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.894673 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.905508 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:09.915818 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:32:10.031737 tst ping.py:19: start network... 19:32:10.246439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:10.738182 run create_hlr_db(pid=19354): Launched 19:32:10.861976 bus /gobi_6: Setting Powered False 19:32:11.925723 run create_hlr_db(pid=19354): Terminated: ok {rc=0} 19:32:12.350865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Launched 19:32:12.648354 run osmo-hlr_10.42.42.2(pid=19357): Launched 19:32:12.762014 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:13.278191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Launched 19:32:13.574797 run osmo-stp_10.42.42.5(pid=19360): Launched 19:32:13.690711 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:32:14.202344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19362): Launched 19:32:14.314945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:32:14.566600 run patchelf(pid=19363): Launched 19:32:14.731230 run osmo-stp_10.42.42.5(pid=19360): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] 19:32:14.856825 run osmo-stp_10.42.42.5(pid=19360): stdout: | (launched: 2022-12-12_19:32:13.519790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:14.984038 run osmo-stp_10.42.42.5(pid=19360): stderr: | 20221212193213687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193213687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193213688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193213688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193213689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193213689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193213689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:15.112003 run osmo-stp_10.42.42.5(pid=19360): stdout: | (launched: 2022-12-12_19:32:13.519790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:15.233217 run osmo-stp_10.42.42.5(pid=19360): stderr: | 20221212193213687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193213687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193213688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193213688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193213689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193213689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193213689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:15.377458 run patchelf(pid=19363): Terminating (SIGINT) 19:32:15.543248 run patchelf(pid=19363): Terminated: ok {rc=0} 19:32:15.662990 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19360): Process ended prematurely: osmo-stp_10.42.42.5(pid=19360) [trial-2381↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] [trial-2381↪gprs:trx-b200↪ping.py:22] 19:32:15.671746 tst ping.py:22: Test FAILED (6.4 sec) 19:32:15.698507 run osmo-hlr_10.42.42.2(pid=19357): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19357)] 19:32:15.745818 run osmo-hlr_10.42.42.2(pid=19357): stdout: | (launched: 2022-12-12_19:32:12.593640) 19:32:15.795399 run osmo-hlr_10.42.42.2(pid=19357): stderr: | 20221212193212767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193212767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193212767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193212767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193212767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193212767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193212779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193212788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193212788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193212788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:15.845265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Terminating (SIGTERM) 19:32:15.888272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminating (SIGTERM) 19:32:15.931855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19362): Terminating (SIGTERM) 19:32:15.972231 --- ParallelTerminationStrategy: PID 19356 died... 19:32:15.991193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Terminated: ok {rc=0} 19:32:16.035963 --- ParallelTerminationStrategy: PID 19359 died... 19:32:16.055265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminated: ok {rc=0} 19:32:16.099524 --- ParallelTerminationStrategy: PID 19362 died... 19:32:16.118579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19362): Terminated: ok {rc=0} 19:32:16.203903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 19:32:17.286009 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.297659 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:32:17.347410 tst ping_idle_ping.py: using LAC 31010 19:32:17.469186 tst ping_idle_ping.py: using RAC 155 19:32:17.585502 tst ping_idle_ping.py: using CellId 31010 19:32:17.701011 tst ping_idle_ping.py: using BVCI 31011 19:32:17.808513 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.819219 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.829786 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.840275 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.851169 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.861597 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.872084 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:32:17.882599 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:32:17.999202 tst ping_idle_ping.py:24: start network... 19:32:18.216283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:18.714675 run create_hlr_db(pid=19364): Launched 19:32:18.837678 bus /gobi_6: Setting Powered False 19:32:19.902299 run create_hlr_db(pid=19364): Terminated: ok {rc=0} 19:32:20.349558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19366): Launched 19:32:20.668498 run osmo-hlr_10.42.42.2(pid=19367): Launched 19:32:20.790205 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:21.340895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19369): Launched 19:32:21.658877 run osmo-stp_10.42.42.5(pid=19370): Launched 19:32:21.782639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:32:22.337642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19372): Launched 19:32:22.461607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:32:22.732165 run patchelf(pid=19373): Launched 19:32:22.910976 run osmo-stp_10.42.42.5(pid=19370): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19370)] 19:32:23.046611 run osmo-stp_10.42.42.5(pid=19370): stdout: | (launched: 2022-12-12_19:32:21.600264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:23.184219 run osmo-stp_10.42.42.5(pid=19370): stderr: | 20221212193221792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193221792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193221792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193221793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193221793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193221793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193221793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:23.321687 run osmo-stp_10.42.42.5(pid=19370): stdout: | (launched: 2022-12-12_19:32:21.600264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:23.453372 run osmo-stp_10.42.42.5(pid=19370): stderr: | 20221212193221792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193221792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193221792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193221793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193221793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193221793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193221793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:23.609396 run patchelf(pid=19373): Terminating (SIGINT) 19:32:23.788208 run patchelf(pid=19373): Terminated: ok {rc=0} 19:32:23.917645 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19370): Process ended prematurely: osmo-stp_10.42.42.5(pid=19370) [trial-2381↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19370)] [trial-2381↪gprs:trx-b200↪ping_idle_ping.py:27] 19:32:23.927280 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:32:23.956633 run osmo-hlr_10.42.42.2(pid=19367): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19367)] 19:32:24.007806 run osmo-hlr_10.42.42.2(pid=19367): stdout: | (launched: 2022-12-12_19:32:20.610272) 19:32:24.060537 run osmo-hlr_10.42.42.2(pid=19367): stderr: | 20221212193220805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193220805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193220805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193220805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193220805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193220805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193220823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193220833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193220833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193220833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:24.113855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19366): Terminating (SIGTERM) 19:32:24.156396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19369): Terminating (SIGTERM) 19:32:24.199351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19372): Terminating (SIGTERM) 19:32:24.242413 --- ParallelTerminationStrategy: PID 19366 died... 19:32:24.262800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19366): Terminated: ok {rc=0} 19:32:24.310063 --- ParallelTerminationStrategy: PID 19369 died... 19:32:24.329824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19369): Terminated: ok {rc=0} 19:32:24.377016 --- ParallelTerminationStrategy: PID 19372 died... 19:32:24.396764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19372): Terminated: ok {rc=0} 19:32:24.486167 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 19:32:25.802390 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:32:25.808024 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:32:25.844272 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:32:25.884432 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:32:25.971177 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:32:26.005489 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:32:26.045150 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:32:26.641121 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:32:26.694501 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:26.705814 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:32:26.756747 tst cs_paging_gprs_active.py: using LAC 31011 19:32:26.884465 tst cs_paging_gprs_active.py: using RAC 156 19:32:27.006749 tst cs_paging_gprs_active.py: using CellId 31011 19:32:27.125326 tst cs_paging_gprs_active.py: using BVCI 31012 19:32:27.234529 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.245575 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.256461 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.267190 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.277763 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.288201 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.298950 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.309473 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:27.320060 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:32:27.439695 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:32:27.557448 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:32:27.761309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:32:28.065358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19378): Launched 19:32:28.330370 run iperf3-srv_10.42.42.10(pid=19379): Launched 19:32:28.445463 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:32:28.650132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:32:28.953980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19380): Launched 19:32:29.219856 run iperf3-srv_10.42.42.10(pid=19381): Launched 19:32:29.333258 tst cs_paging_gprs_active.py:38: start network... 19:32:29.535332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:30.002401 run create_hlr_db(pid=19382): Launched 19:32:30.128120 bus /gobi_6: Setting Powered False 19:32:31.203853 run create_hlr_db(pid=19382): Terminated: ok {rc=0} 19:32:31.728239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19384): Launched 19:32:32.050431 run osmo-hlr_10.42.42.2(pid=19385): Launched 19:32:32.268206 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:32.828029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19387): Launched 19:32:33.153633 run osmo-stp_10.42.42.5(pid=19388): Launched 19:32:33.277594 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:32:33.837411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19390): Launched 19:32:33.961703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:32:34.236009 run patchelf(pid=19391): Launched 19:32:34.416376 run osmo-stp_10.42.42.5(pid=19388): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19388)] 19:32:34.554383 run osmo-stp_10.42.42.5(pid=19388): stdout: | (launched: 2022-12-12_19:32:33.093858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:34.694471 run osmo-stp_10.42.42.5(pid=19388): stderr: | 20221212193233284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193233284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193233284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193233285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193233285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193233285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193233286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:34.835017 run osmo-stp_10.42.42.5(pid=19388): stdout: | (launched: 2022-12-12_19:32:33.093858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:34.968312 run osmo-stp_10.42.42.5(pid=19388): stderr: | 20221212193233284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193233284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193233284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193233285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193233285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193233285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193233286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:35.126533 run patchelf(pid=19391): Terminating (SIGINT) 19:32:35.309389 run patchelf(pid=19391): Terminated: ok {rc=0} 19:32:35.441180 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19388): Process ended prematurely: osmo-stp_10.42.42.5(pid=19388) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19388)] [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:32:35.451461 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:32:35.480245 run osmo-hlr_10.42.42.2(pid=19385): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19385)] 19:32:35.531067 run osmo-hlr_10.42.42.2(pid=19385): stdout: | (launched: 2022-12-12_19:32:31.993725) 19:32:35.583148 run osmo-hlr_10.42.42.2(pid=19385): stderr: | 20221212193232275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193232275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193232275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193232275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193232275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193232275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193232287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193232296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193232296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193232296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:35.635392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19378): Terminating (SIGTERM) 19:32:35.677649 run iperf3-srv_10.42.42.10(pid=19379): Terminating (SIGTERM) 19:32:35.719477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19380): Terminating (SIGTERM) 19:32:35.761294 run iperf3-srv_10.42.42.10(pid=19381): Terminating (SIGTERM) 19:32:35.803375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19384): Terminating (SIGTERM) 19:32:35.845287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19387): Terminating (SIGTERM) 19:32:35.887285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19390): Terminating (SIGTERM) 19:32:35.929647 --- ParallelTerminationStrategy: PID 19378 died... 19:32:35.949617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19378): Terminated: ok {rc=0} 19:32:35.996083 --- ParallelTerminationStrategy: PID 19379 died... 19:32:36.015387 run iperf3-srv_10.42.42.10(pid=19379): Terminated {rc=256} 19:32:36.061627 --- ParallelTerminationStrategy: PID 19380 died... 19:32:36.081057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19380): Terminated: ok {rc=0} 19:32:36.127490 --- ParallelTerminationStrategy: PID 19381 died... 19:32:36.146908 run iperf3-srv_10.42.42.10(pid=19381): Terminated {rc=256} 19:32:36.193476 --- ParallelTerminationStrategy: PID 19384 died... 19:32:36.212726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19384): Terminated: ok {rc=0} 19:32:36.259296 --- ParallelTerminationStrategy: PID 19387 died... 19:32:36.278734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19387): Terminated: ok {rc=0} 19:32:36.324894 --- ParallelTerminationStrategy: PID 19390 died... 19:32:36.344863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19390): Terminated: ok {rc=0} 19:32:36.432621 bus /gobi_0: Setting Powered False 19:32:37.532658 bus /gobi_0: Setting Powered False 19:32:38.648926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:32:39.799759 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:39.812010 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:32:39.866227 tst iperf3.py: using LAC 31012 19:32:39.993653 tst iperf3.py: using RAC 157 19:32:40.114688 tst iperf3.py: using CellId 31012 19:32:40.234574 tst iperf3.py: using BVCI 31013 19:32:40.344705 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.355724 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.366586 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.377888 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.389176 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.400221 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.411490 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.423003 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:40.433773 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:32:40.550509 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:32:40.770283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:32:41.097814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19392): Launched 19:32:41.380083 run iperf3-srv_10.42.42.10(pid=19393): Launched 19:32:41.502205 tst iperf3.py:8: start network... 19:32:41.721385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:42.223891 run create_hlr_db(pid=19394): Launched 19:32:42.347243 bus /gobi_6: Setting Powered False 19:32:43.410941 run create_hlr_db(pid=19394): Terminated: ok {rc=0} 19:32:43.861957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19396): Launched 19:32:44.184440 run osmo-hlr_10.42.42.2(pid=19397): Launched 19:32:44.307546 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:44.867994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19399): Launched 19:32:45.190193 run osmo-stp_10.42.42.5(pid=19400): Launched 19:32:45.315328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:32:45.885415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19402): Launched 19:32:46.028245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:32:46.317772 run patchelf(pid=19403): Launched 19:32:46.509820 run osmo-stp_10.42.42.5(pid=19400): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19400)] 19:32:46.651656 run osmo-stp_10.42.42.5(pid=19400): stdout: | (launched: 2022-12-12_19:32:45.131343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:46.794689 run osmo-stp_10.42.42.5(pid=19400): stderr: | 20221212193245322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193245322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193245322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193245323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193245323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193245323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193245323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:46.939600 run osmo-stp_10.42.42.5(pid=19400): stdout: | (launched: 2022-12-12_19:32:45.131343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:47.076305 run osmo-stp_10.42.42.5(pid=19400): stderr: | 20221212193245322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193245322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193245322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193245323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193245323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193245323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193245323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:47.238102 run patchelf(pid=19403): Terminating (SIGINT) 19:32:47.419848 run patchelf(pid=19403): Terminated: ok {rc=0} 19:32:47.551395 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19400): Process ended prematurely: osmo-stp_10.42.42.5(pid=19400) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19400)] [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 19:32:47.561520 tst iperf3.py:8: Test FAILED (7.8 sec) 19:32:47.590540 run osmo-hlr_10.42.42.2(pid=19397): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19397)] 19:32:47.640851 run osmo-hlr_10.42.42.2(pid=19397): stdout: | (launched: 2022-12-12_19:32:44.125678) 19:32:47.693622 run osmo-hlr_10.42.42.2(pid=19397): stderr: | 20221212193244322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193244322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193244322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193244322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193244322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193244322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193244334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193244343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193244343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193244343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:47.746467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19392): Terminating (SIGTERM) 19:32:47.788336 run iperf3-srv_10.42.42.10(pid=19393): Terminating (SIGTERM) 19:32:47.830651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19396): Terminating (SIGTERM) 19:32:47.872696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19399): Terminating (SIGTERM) 19:32:47.914702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19402): Terminating (SIGTERM) 19:32:47.957533 --- ParallelTerminationStrategy: PID 19392 died... 19:32:47.977284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19392): Terminated: ok {rc=0} 19:32:48.024574 --- ParallelTerminationStrategy: PID 19393 died... 19:32:48.044285 run iperf3-srv_10.42.42.10(pid=19393): Terminated {rc=256} 19:32:48.091232 --- ParallelTerminationStrategy: PID 19396 died... 19:32:48.110829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19396): Terminated: ok {rc=0} 19:32:48.157393 --- ParallelTerminationStrategy: PID 19399 died... 19:32:48.177002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19399): Terminated: ok {rc=0} 19:32:48.224460 --- ParallelTerminationStrategy: PID 19402 died... 19:32:48.244209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19402): Terminated: ok {rc=0} 19:32:48.333881 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:32:49.483609 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:49.495677 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:32:49.547640 tst iperf3m4.py: using LAC 31013 19:32:49.673379 tst iperf3m4.py: using RAC 158 19:32:49.800853 tst iperf3m4.py: using CellId 31013 19:32:49.931822 tst iperf3m4.py: using BVCI 31014 19:32:50.049562 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.060878 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.072063 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.083491 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.094935 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.106491 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.118140 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.129609 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:32:50.141163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:32:50.258637 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:32:50.381579 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:32:50.502018 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:32:50.618919 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:32:50.822791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:32:51.127789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19404): Launched 19:32:51.392489 run iperf3-srv_10.42.42.10(pid=19405): Launched 19:32:51.506062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:32:51.707189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:32:52.012361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19406): Launched 19:32:52.277503 run iperf3-srv_10.42.42.10(pid=19407): Launched 19:32:52.390657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:32:52.592553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:32:52.897396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19408): Launched 19:32:53.160478 run iperf3-srv_10.42.42.10(pid=19409): Launched 19:32:53.273597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:32:53.475271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:32:53.779318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19410): Launched 19:32:54.044677 run iperf3-srv_10.42.42.10(pid=19411): Launched 19:32:54.157919 tst iperf3m4.py:8: start network... 19:32:54.359885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:54.829043 run create_hlr_db(pid=19412): Launched 19:32:54.953461 bus /gobi_6: Setting Powered False 19:32:56.017167 run create_hlr_db(pid=19412): Terminated: ok {rc=0} 19:32:56.469454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19414): Launched 19:32:56.796535 run osmo-hlr_10.42.42.2(pid=19415): Launched 19:32:56.921218 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:57.479455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19417): Launched 19:32:57.806611 run osmo-stp_10.42.42.5(pid=19418): Launched 19:32:57.934091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:32:58.493655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19420): Launched 19:32:58.617826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:32:58.893715 run patchelf(pid=19421): Launched 19:32:59.074596 run osmo-stp_10.42.42.5(pid=19418): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19418)] 19:32:59.212222 run osmo-stp_10.42.42.5(pid=19418): stdout: | (launched: 2022-12-12_19:32:57.747187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:59.351686 run osmo-stp_10.42.42.5(pid=19418): stderr: | 20221212193257935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193257935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193257935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193257936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193257936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193257936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193257936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:59.491512 run osmo-stp_10.42.42.5(pid=19418): stdout: | (launched: 2022-12-12_19:32:57.747187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:59.624639 run osmo-stp_10.42.42.5(pid=19418): stderr: | 20221212193257935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193257935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193257935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193257936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193257936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193257936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193257936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:59.782405 run patchelf(pid=19421): Terminating (SIGINT) 19:32:59.964375 run patchelf(pid=19421): Terminated: ok {rc=0} 19:33:00.095761 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19418): Process ended prematurely: osmo-stp_10.42.42.5(pid=19418) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19418)] [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 19:33:00.106030 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:33:00.135365 run osmo-hlr_10.42.42.2(pid=19415): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19415)] 19:33:00.186281 run osmo-hlr_10.42.42.2(pid=19415): stdout: | (launched: 2022-12-12_19:32:56.736895) 19:33:00.238626 run osmo-hlr_10.42.42.2(pid=19415): stderr: | 20221212193256936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193256936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193256936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193256937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193256937 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193256937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193256948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193256957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193256957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193256957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:00.291257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19404): Terminating (SIGTERM) 19:33:00.333148 run iperf3-srv_10.42.42.10(pid=19405): Terminating (SIGTERM) 19:33:00.375703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19406): Terminating (SIGTERM) 19:33:00.418353 run iperf3-srv_10.42.42.10(pid=19407): Terminating (SIGTERM) 19:33:00.460508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19408): Terminating (SIGTERM) 19:33:00.502914 run iperf3-srv_10.42.42.10(pid=19409): Terminating (SIGTERM) 19:33:00.545073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19410): Terminating (SIGTERM) 19:33:00.587295 run iperf3-srv_10.42.42.10(pid=19411): Terminating (SIGTERM) 19:33:00.629512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19414): Terminating (SIGTERM) 19:33:00.671758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19417): Terminating (SIGTERM) 19:33:00.713910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19420): Terminating (SIGTERM) 19:33:00.756323 --- ParallelTerminationStrategy: PID 19404 died... 19:33:00.776558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19404): Terminated: ok {rc=0} 19:33:00.824713 --- ParallelTerminationStrategy: PID 19405 died... 19:33:00.844720 run iperf3-srv_10.42.42.10(pid=19405): Terminated {rc=256} 19:33:00.894167 --- ParallelTerminationStrategy: PID 19406 died... 19:33:00.917050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19406): Terminated: ok {rc=0} 19:33:00.965258 --- ParallelTerminationStrategy: PID 19407 died... 19:33:00.985479 run iperf3-srv_10.42.42.10(pid=19407): Terminated {rc=256} 19:33:01.033341 --- ParallelTerminationStrategy: PID 19408 died... 19:33:01.053658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19408): Terminated: ok {rc=0} 19:33:01.101608 --- ParallelTerminationStrategy: PID 19409 died... 19:33:01.122095 run iperf3-srv_10.42.42.10(pid=19409): Terminated {rc=256} 19:33:01.170005 --- ParallelTerminationStrategy: PID 19410 died... 19:33:01.190415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19410): Terminated: ok {rc=0} 19:33:01.238295 --- ParallelTerminationStrategy: PID 19411 died... 19:33:01.269114 run iperf3-srv_10.42.42.10(pid=19411): Terminated {rc=256} 19:33:01.331418 --- ParallelTerminationStrategy: PID 19414 died... 19:33:01.351782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19414): Terminated: ok {rc=0} 19:33:01.399603 --- ParallelTerminationStrategy: PID 19417 died... 19:33:01.419873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19417): Terminated: ok {rc=0} 19:33:01.467389 --- ParallelTerminationStrategy: PID 19420 died... 19:33:01.487656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19420): Terminated: ok {rc=0} 19:33:01.588176 bus /gobi_4: Setting Powered False 19:33:02.697730 bus /gobi_4: Setting Powered False 19:33:03.815861 bus /gobi_1: Setting Powered False 19:33:04.916106 bus /gobi_1: Setting Powered False 19:33:06.031717 bus /gobi_0: Setting Powered False 19:33:07.131958 bus /gobi_0: Setting Powered False 19:33:08.249682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 19:33:09.353908 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.365861 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:33:09.422070 tst ping.py: using LAC 31014 19:33:09.547604 tst ping.py: using RAC 159 19:33:09.674625 tst ping.py: using CellId 31014 19:33:09.797288 tst ping.py: using BVCI 31015 19:33:09.913743 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.925516 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.936609 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.948135 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.959532 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.970978 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.982654 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:09.994239 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:33:10.112427 tst ping.py:19: start network... 19:33:10.326146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:10.817792 run create_hlr_db(pid=19423): Launched 19:33:10.940023 bus /gobi_6: Setting Powered False 19:33:12.003916 run create_hlr_db(pid=19423): Terminated: ok {rc=0} 19:33:12.429972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19425): Launched 19:33:12.727239 run osmo-hlr_10.42.42.2(pid=19426): Launched 19:33:12.840085 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:13.370076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19428): Launched 19:33:13.666395 run osmo-stp_10.42.42.5(pid=19429): Launched 19:33:13.782120 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:33:14.296669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19431): Launched 19:33:14.410336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:33:14.662007 run patchelf(pid=19432): Launched 19:33:14.829181 run osmo-stp_10.42.42.5(pid=19429): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19429)] 19:33:14.955687 run osmo-stp_10.42.42.5(pid=19429): stdout: | (launched: 2022-12-12_19:33:13.611353) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:15.082931 run osmo-stp_10.42.42.5(pid=19429): stderr: | 20221212193313779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193313779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193313779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193313780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193313780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193313780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193313781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:15.210507 run osmo-stp_10.42.42.5(pid=19429): stdout: | (launched: 2022-12-12_19:33:13.611353) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:15.331964 run osmo-stp_10.42.42.5(pid=19429): stderr: | 20221212193313779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193313779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193313779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193313780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193313780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193313780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193313781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:15.475742 run patchelf(pid=19432): Terminating (SIGINT) 19:33:15.641543 run patchelf(pid=19432): Terminated: ok {rc=0} 19:33:15.760703 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19429): Process ended prematurely: osmo-stp_10.42.42.5(pid=19429) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19429)] [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 19:33:15.770232 tst ping.py:22: Test FAILED (6.4 sec) 19:33:15.797734 run osmo-hlr_10.42.42.2(pid=19426): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19426)] 19:33:15.863230 run osmo-hlr_10.42.42.2(pid=19426): stdout: | (launched: 2022-12-12_19:33:12.672327) 19:33:15.921961 run osmo-hlr_10.42.42.2(pid=19426): stderr: | 20221212193312847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193312847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193312847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193312847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193312847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193312847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193312861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193312871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193312872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193312872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:15.973199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19425): Terminating (SIGTERM) 19:33:16.014574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19428): Terminating (SIGTERM) 19:33:16.056510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19431): Terminating (SIGTERM) 19:33:16.098666 --- ParallelTerminationStrategy: PID 19425 died... 19:33:16.118228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19425): Terminated: ok {rc=0} 19:33:16.163449 --- ParallelTerminationStrategy: PID 19428 died... 19:33:16.182845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19428): Terminated: ok {rc=0} 19:33:16.227981 --- ParallelTerminationStrategy: PID 19431 died... 19:33:16.247422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19431): Terminated: ok {rc=0} 19:33:16.332357 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:33:17.417553 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:17.430155 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:33:17.485445 tst ping_idle_ping.py: using LAC 31015 19:33:17.603656 tst ping_idle_ping.py: using RAC 160 19:33:17.721150 tst ping_idle_ping.py: using CellId 31015 19:33:17.837292 tst ping_idle_ping.py: using BVCI 31016 19:33:17.944780 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:17.955950 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:17.966655 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:17.977585 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:17.988442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:17.999271 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:18.010160 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:33:18.020779 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:33:18.133552 tst ping_idle_ping.py:24: start network... 19:33:18.332640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:18.795106 run create_hlr_db(pid=19433): Launched 19:33:18.917273 bus /gobi_6: Setting Powered False 19:33:19.977441 run create_hlr_db(pid=19433): Terminated: ok {rc=0} 19:33:20.414203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19435): Launched 19:33:20.735787 run osmo-hlr_10.42.42.2(pid=19436): Launched 19:33:20.860511 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:21.415749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19438): Launched 19:33:21.737098 run osmo-stp_10.42.42.5(pid=19439): Launched 19:33:21.861205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:33:22.415329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19441): Launched 19:33:22.539439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:33:22.810573 run patchelf(pid=19442): Launched 19:33:22.990744 run osmo-stp_10.42.42.5(pid=19439): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19439)] 19:33:23.126657 run osmo-stp_10.42.42.5(pid=19439): stdout: | (launched: 2022-12-12_19:33:21.678449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:23.264158 run osmo-stp_10.42.42.5(pid=19439): stderr: | 20221212193321867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193321867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193321868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193321868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193321868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193321869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193321869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:23.401997 run osmo-stp_10.42.42.5(pid=19439): stdout: | (launched: 2022-12-12_19:33:21.678449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:23.533758 run osmo-stp_10.42.42.5(pid=19439): stderr: | 20221212193321867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193321867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193321868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193321868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193321868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193321869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193321869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:23.689648 run patchelf(pid=19442): Terminating (SIGINT) 19:33:23.869368 run patchelf(pid=19442): Terminated: ok {rc=0} 19:33:23.998628 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19439): Process ended prematurely: osmo-stp_10.42.42.5(pid=19439) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19439)] [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 19:33:24.008208 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:33:24.036935 run osmo-hlr_10.42.42.2(pid=19436): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19436)] 19:33:24.087993 run osmo-hlr_10.42.42.2(pid=19436): stdout: | (launched: 2022-12-12_19:33:20.677312) 19:33:24.140581 run osmo-hlr_10.42.42.2(pid=19436): stderr: | 20221212193320874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193320874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193320874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193320874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193320874 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193320874 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193320887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193320895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193320895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193320895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:24.193982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19435): Terminating (SIGTERM) 19:33:24.236366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19438): Terminating (SIGTERM) 19:33:24.278919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19441): Terminating (SIGTERM) 19:33:24.321794 --- ParallelTerminationStrategy: PID 19435 died... 19:33:24.342043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19435): Terminated: ok {rc=0} 19:33:24.389629 --- ParallelTerminationStrategy: PID 19438 died... 19:33:24.409285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19438): Terminated: ok {rc=0} 19:33:24.456750 --- ParallelTerminationStrategy: PID 19441 died... 19:33:24.476542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19441): Terminated: ok {rc=0} 19:33:24.566249 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:33:25.877947 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:33:25.884585 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:33:25.920216 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:33:25.960179 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:33:26.049607 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:33:26.083882 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:33:26.123839 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:33:26.718322 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:33:26.771486 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:26.782997 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:33:26.858037 tst cs_paging_gprs_active.py: using LAC 31016 19:33:26.985226 tst cs_paging_gprs_active.py: using RAC 161 19:33:27.113196 tst cs_paging_gprs_active.py: using CellId 31016 19:33:27.238851 tst cs_paging_gprs_active.py: using BVCI 31017 19:33:27.358396 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.369943 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.380897 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.392421 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.403977 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.415637 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.427430 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.438989 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:27.450695 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:33:27.568021 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:33:27.688660 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:33:27.909293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:28.236019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19446): Launched 19:33:28.519780 run iperf3-srv_10.42.42.10(pid=19447): Launched 19:33:28.643549 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:33:28.863227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:29.190738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19448): Launched 19:33:29.475697 run iperf3-srv_10.42.42.10(pid=19449): Launched 19:33:29.597566 tst cs_paging_gprs_active.py:38: start network... 19:33:29.816712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:30.319999 run create_hlr_db(pid=19450): Launched 19:33:30.443857 bus /gobi_6: Setting Powered False 19:33:31.524499 run create_hlr_db(pid=19450): Terminated: ok {rc=0} 19:33:32.061579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19452): Launched 19:33:32.383315 run osmo-hlr_10.42.42.2(pid=19453): Launched 19:33:32.499073 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:33.034486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19455): Launched 19:33:33.337225 run osmo-stp_10.42.42.5(pid=19456): Launched 19:33:33.452582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:33:33.974585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19458): Launched 19:33:34.092751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:33:34.348820 run patchelf(pid=19459): Launched 19:33:34.517408 run osmo-stp_10.42.42.5(pid=19456): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19456)] 19:33:34.645863 run osmo-stp_10.42.42.5(pid=19456): stdout: | (launched: 2022-12-12_19:33:33.281711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:34.775526 run osmo-stp_10.42.42.5(pid=19456): stderr: | 20221212193333451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193333451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193333452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193333452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193333453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193333453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193333453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:34.905339 run osmo-stp_10.42.42.5(pid=19456): stdout: | (launched: 2022-12-12_19:33:33.281711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:35.029410 run osmo-stp_10.42.42.5(pid=19456): stderr: | 20221212193333451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193333451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193333452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193333452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193333453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193333453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193333453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:35.177107 run patchelf(pid=19459): Terminating (SIGINT) 19:33:35.347361 run patchelf(pid=19459): Terminated: ok {rc=0} 19:33:35.469450 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19456): Process ended prematurely: osmo-stp_10.42.42.5(pid=19456) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19456)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:33:35.478883 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:33:35.505962 run osmo-hlr_10.42.42.2(pid=19453): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19453)] 19:33:35.553709 run osmo-hlr_10.42.42.2(pid=19453): stdout: | (launched: 2022-12-12_19:33:32.327966) 19:33:35.603244 run osmo-hlr_10.42.42.2(pid=19453): stderr: | 20221212193332502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193332502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193332502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193332502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193332502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193332502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193332515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193332523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193332524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193332524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:35.653150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19446): Terminating (SIGTERM) 19:33:35.692977 run iperf3-srv_10.42.42.10(pid=19447): Terminating (SIGTERM) 19:33:35.732411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19448): Terminating (SIGTERM) 19:33:35.772077 run iperf3-srv_10.42.42.10(pid=19449): Terminating (SIGTERM) 19:33:35.811579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19452): Terminating (SIGTERM) 19:33:35.851125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19455): Terminating (SIGTERM) 19:33:35.890627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19458): Terminating (SIGTERM) 19:33:35.930470 --- ParallelTerminationStrategy: PID 19446 died... 19:33:35.949730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19446): Terminated: ok {rc=0} 19:33:35.993934 --- ParallelTerminationStrategy: PID 19447 died... 19:33:36.012468 run iperf3-srv_10.42.42.10(pid=19447): Terminated {rc=256} 19:33:36.056522 --- ParallelTerminationStrategy: PID 19448 died... 19:33:36.075311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19448): Terminated: ok {rc=0} 19:33:36.119451 --- ParallelTerminationStrategy: PID 19449 died... 19:33:36.138127 run iperf3-srv_10.42.42.10(pid=19449): Terminated {rc=256} 19:33:36.182268 --- ParallelTerminationStrategy: PID 19452 died... 19:33:36.200843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19452): Terminated: ok {rc=0} 19:33:36.244605 --- ParallelTerminationStrategy: PID 19455 died... 19:33:36.263312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19455): Terminated: ok {rc=0} 19:33:36.307619 --- ParallelTerminationStrategy: PID 19458 died... 19:33:36.326249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19458): Terminated: ok {rc=0} 19:33:36.412133 bus /gobi_0: Setting Powered False 19:33:37.512299 bus /gobi_0: Setting Powered False 19:33:38.624640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:33:39.774653 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:39.786849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:33:39.862553 tst iperf3.py: using LAC 31017 19:33:39.991277 tst iperf3.py: using RAC 162 19:33:40.117969 tst iperf3.py: using CellId 31017 19:33:40.246118 tst iperf3.py: using BVCI 31018 19:33:40.364006 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.375432 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.386640 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.398323 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.409794 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.421235 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.432684 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.444508 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:40.456197 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:33:40.575693 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:33:40.794644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:41.120913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19460): Launched 19:33:41.402974 run iperf3-srv_10.42.42.10(pid=19461): Launched 19:33:41.526460 tst iperf3.py:8: start network... 19:33:41.745894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:42.247840 run create_hlr_db(pid=19462): Launched 19:33:42.372225 bus /gobi_6: Setting Powered False 19:33:43.436784 run create_hlr_db(pid=19462): Terminated: ok {rc=0} 19:33:43.869875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19464): Launched 19:33:44.171265 run osmo-hlr_10.42.42.2(pid=19465): Launched 19:33:44.286150 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:44.806276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19467): Launched 19:33:45.107531 run osmo-stp_10.42.42.5(pid=19468): Launched 19:33:45.222250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:33:45.743097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19470): Launched 19:33:45.869856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:33:46.132278 run patchelf(pid=19471): Launched 19:33:46.344618 run osmo-stp_10.42.42.5(pid=19468): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19468)] 19:33:46.476594 run osmo-stp_10.42.42.5(pid=19468): stdout: | (launched: 2022-12-12_19:33:45.051799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:46.610505 run osmo-stp_10.42.42.5(pid=19468): stderr: | 20221212193345221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193345222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193345222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193345222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193345223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193345223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193345223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:46.744593 run osmo-stp_10.42.42.5(pid=19468): stdout: | (launched: 2022-12-12_19:33:45.051799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:46.871608 run osmo-stp_10.42.42.5(pid=19468): stderr: | 20221212193345221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193345222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193345222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193345222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193345223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193345223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193345223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:47.021919 run patchelf(pid=19471): Terminating (SIGINT) 19:33:47.197281 run patchelf(pid=19471): Terminated: ok {rc=0} 19:33:47.322058 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19468): Process ended prematurely: osmo-stp_10.42.42.5(pid=19468) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19468)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 19:33:47.331961 tst iperf3.py:8: Test FAILED (7.6 sec) 19:33:47.360015 run osmo-hlr_10.42.42.2(pid=19465): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19465)] 19:33:47.408310 run osmo-hlr_10.42.42.2(pid=19465): stdout: | (launched: 2022-12-12_19:33:44.115939) 19:33:47.458409 run osmo-hlr_10.42.42.2(pid=19465): stderr: | 20221212193344289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193344289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193344289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193344289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193344289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193344289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193344301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193344310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193344310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193344310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:47.509135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19460): Terminating (SIGTERM) 19:33:47.549123 run iperf3-srv_10.42.42.10(pid=19461): Terminating (SIGTERM) 19:33:47.589130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19464): Terminating (SIGTERM) 19:33:47.629575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19467): Terminating (SIGTERM) 19:33:47.669362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19470): Terminating (SIGTERM) 19:33:47.709588 --- ParallelTerminationStrategy: PID 19460 died... 19:33:47.728786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19460): Terminated: ok {rc=0} 19:33:47.773176 --- ParallelTerminationStrategy: PID 19461 died... 19:33:47.791786 run iperf3-srv_10.42.42.10(pid=19461): Terminated {rc=256} 19:33:47.836262 --- ParallelTerminationStrategy: PID 19464 died... 19:33:47.854968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19464): Terminated: ok {rc=0} 19:33:47.898836 --- ParallelTerminationStrategy: PID 19467 died... 19:33:47.917607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19467): Terminated: ok {rc=0} 19:33:47.961847 --- ParallelTerminationStrategy: PID 19470 died... 19:33:47.980536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19470): Terminated: ok {rc=0} 19:33:48.067013 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:33:49.214824 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.226504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:33:49.297352 tst iperf3m4.py: using LAC 31018 19:33:49.414987 tst iperf3m4.py: using RAC 163 19:33:49.535051 tst iperf3m4.py: using CellId 31018 19:33:49.655250 tst iperf3m4.py: using BVCI 31019 19:33:49.766131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.777121 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.787877 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.798668 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.809456 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.820231 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.831068 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.841839 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:33:49.852681 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:33:49.971590 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:33:50.090662 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:33:50.210355 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:33:50.331537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:33:50.552154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:50.880820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19473): Launched 19:33:51.165751 run iperf3-srv_10.42.42.10(pid=19474): Launched 19:33:51.288801 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:33:51.508368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:51.835281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19475): Launched 19:33:52.119531 run iperf3-srv_10.42.42.10(pid=19476): Launched 19:33:52.241437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:33:52.460496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:52.788174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19477): Launched 19:33:53.071901 run iperf3-srv_10.42.42.10(pid=19478): Launched 19:33:53.194205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:33:53.413952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:33:53.740891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19479): Launched 19:33:54.025414 run iperf3-srv_10.42.42.10(pid=19480): Launched 19:33:54.147228 tst iperf3m4.py:8: start network... 19:33:54.365962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:54.871027 run create_hlr_db(pid=19481): Launched 19:33:54.995624 bus /gobi_6: Setting Powered False 19:33:56.058701 run create_hlr_db(pid=19481): Terminated: ok {rc=0} 19:33:56.511295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19483): Launched 19:33:56.838958 run osmo-hlr_10.42.42.2(pid=19484): Launched 19:33:56.965193 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:57.527957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19486): Launched 19:33:57.852887 run osmo-stp_10.42.42.5(pid=19487): Launched 19:33:57.977660 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:33:58.540867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19489): Launched 19:33:58.665969 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:33:58.942060 run patchelf(pid=19490): Launched 19:33:59.123634 run osmo-stp_10.42.42.5(pid=19487): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19487)] 19:33:59.262399 run osmo-stp_10.42.42.5(pid=19487): stdout: | (launched: 2022-12-12_19:33:57.792836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:59.402754 run osmo-stp_10.42.42.5(pid=19487): stderr: | 20221212193357985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193357985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193357985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193357986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193357986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193357986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193357986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:59.542739 run osmo-stp_10.42.42.5(pid=19487): stdout: | (launched: 2022-12-12_19:33:57.792836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:59.676400 run osmo-stp_10.42.42.5(pid=19487): stderr: | 20221212193357985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193357985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193357985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193357986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193357986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193357986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193357986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:59.834529 run patchelf(pid=19490): Terminating (SIGINT) 19:34:00.017716 run patchelf(pid=19490): Terminated: ok {rc=0} 19:34:00.150168 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19487): Process ended prematurely: osmo-stp_10.42.42.5(pid=19487) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19487)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:34:00.160284 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:34:00.189920 run osmo-hlr_10.42.42.2(pid=19484): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19484)] 19:34:00.240557 run osmo-hlr_10.42.42.2(pid=19484): stdout: | (launched: 2022-12-12_19:33:56.778369) 19:34:00.293194 run osmo-hlr_10.42.42.2(pid=19484): stderr: | 20221212193356977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193356977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193356977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193356977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193356977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193356977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193356990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193356998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193356999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193356999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:00.345987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19473): Terminating (SIGTERM) 19:34:00.388437 run iperf3-srv_10.42.42.10(pid=19474): Terminating (SIGTERM) 19:34:00.431236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19475): Terminating (SIGTERM) 19:34:00.474018 run iperf3-srv_10.42.42.10(pid=19476): Terminating (SIGTERM) 19:34:00.516740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19477): Terminating (SIGTERM) 19:34:00.559662 run iperf3-srv_10.42.42.10(pid=19478): Terminating (SIGTERM) 19:34:00.602251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19479): Terminating (SIGTERM) 19:34:00.644882 run iperf3-srv_10.42.42.10(pid=19480): Terminating (SIGTERM) 19:34:00.687530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19483): Terminating (SIGTERM) 19:34:00.729965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19486): Terminating (SIGTERM) 19:34:00.772589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19489): Terminating (SIGTERM) 19:34:00.816285 --- ParallelTerminationStrategy: PID 19473 died... 19:34:00.848788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19473): Terminated: ok {rc=0} 19:34:00.906030 --- ParallelTerminationStrategy: PID 19474 died... 19:34:00.926996 run iperf3-srv_10.42.42.10(pid=19474): Terminated {rc=256} 19:34:00.976292 --- ParallelTerminationStrategy: PID 19475 died... 19:34:00.997071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19475): Terminated: ok {rc=0} 19:34:01.046639 --- ParallelTerminationStrategy: PID 19476 died... 19:34:01.067490 run iperf3-srv_10.42.42.10(pid=19476): Terminated {rc=256} 19:34:01.117279 --- ParallelTerminationStrategy: PID 19477 died... 19:34:01.138091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19477): Terminated: ok {rc=0} 19:34:01.187629 --- ParallelTerminationStrategy: PID 19478 died... 19:34:01.208406 run iperf3-srv_10.42.42.10(pid=19478): Terminated {rc=256} 19:34:01.257842 --- ParallelTerminationStrategy: PID 19479 died... 19:34:01.278737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19479): Terminated: ok {rc=0} 19:34:01.328530 --- ParallelTerminationStrategy: PID 19480 died... 19:34:01.349411 run iperf3-srv_10.42.42.10(pid=19480): Terminated {rc=256} 19:34:01.398773 --- ParallelTerminationStrategy: PID 19483 died... 19:34:01.419558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19483): Terminated: ok {rc=0} 19:34:01.469216 --- ParallelTerminationStrategy: PID 19486 died... 19:34:01.490163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19486): Terminated: ok {rc=0} 19:34:01.539811 --- ParallelTerminationStrategy: PID 19489 died... 19:34:01.560789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19489): Terminated: ok {rc=0} 19:34:01.654099 bus /gobi_4: Setting Powered False 19:34:02.755438 bus /gobi_4: Setting Powered False 19:34:03.874993 bus /gobi_1: Setting Powered False 19:34:04.977867 bus /gobi_1: Setting Powered False 19:34:06.095744 bus /gobi_0: Setting Powered False 19:34:07.194565 bus /gobi_0: Setting Powered False 19:34:08.315766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:34:09.420348 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:09.432099 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:34:09.502348 tst ping.py: using LAC 31019 19:34:09.623368 tst ping.py: using RAC 164 19:34:09.739988 tst ping.py: using CellId 31019 19:34:09.855343 tst ping.py: using BVCI 31020 19:34:09.963350 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:09.974367 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:09.985029 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:09.996336 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:10.007584 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:10.018876 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:10.030266 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:10.041496 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:34:10.160472 tst ping.py:19: start network... 19:34:10.375353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:10.869078 run create_hlr_db(pid=19491): Launched 19:34:10.999995 bus /gobi_6: Setting Powered False 19:34:12.063963 run create_hlr_db(pid=19491): Terminated: ok {rc=0} 19:34:12.491376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19493): Launched 19:34:12.789096 run osmo-hlr_10.42.42.2(pid=19494): Launched 19:34:12.901499 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:13.432856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19496): Launched 19:34:13.730131 run osmo-stp_10.42.42.5(pid=19497): Launched 19:34:13.843438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:14.355812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19499): Launched 19:34:14.469194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:14.720446 run patchelf(pid=19500): Launched 19:34:14.885225 run osmo-stp_10.42.42.5(pid=19497): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19497)] 19:34:15.011079 run osmo-stp_10.42.42.5(pid=19497): stdout: | (launched: 2022-12-12_19:34:13.675503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:15.138707 run osmo-stp_10.42.42.5(pid=19497): stderr: | 20221212193413842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193413842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193413843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193413843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193413844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193413844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193413844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:15.266579 run osmo-stp_10.42.42.5(pid=19497): stdout: | (launched: 2022-12-12_19:34:13.675503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:15.388868 run osmo-stp_10.42.42.5(pid=19497): stderr: | 20221212193413842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193413842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193413843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193413843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193413844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193413844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193413844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:15.533432 run patchelf(pid=19500): Terminating (SIGINT) 19:34:15.699791 run patchelf(pid=19500): Terminated: ok {rc=0} 19:34:15.820072 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19497): Process ended prematurely: osmo-stp_10.42.42.5(pid=19497) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19497)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 19:34:15.829038 tst ping.py:22: Test FAILED (6.4 sec) 19:34:15.868675 run osmo-hlr_10.42.42.2(pid=19494): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19494)] 19:34:15.923885 run osmo-hlr_10.42.42.2(pid=19494): stdout: | (launched: 2022-12-12_19:34:12.734248) 19:34:15.979816 run osmo-hlr_10.42.42.2(pid=19494): stderr: | 20221212193412908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193412908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193412908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193412908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193412908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193412908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193412920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193412929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193412930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193412930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:16.036266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19493): Terminating (SIGTERM) 19:34:16.081904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19496): Terminating (SIGTERM) 19:34:16.132835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19499): Terminating (SIGTERM) 19:34:16.180138 --- ParallelTerminationStrategy: PID 19493 died... 19:34:16.201486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19493): Terminated: ok {rc=0} 19:34:16.253281 --- ParallelTerminationStrategy: PID 19496 died... 19:34:16.274814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19496): Terminated: ok {rc=0} 19:34:16.326224 --- ParallelTerminationStrategy: PID 19499 died... 19:34:16.347433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19499): Terminated: ok {rc=0} 19:34:16.440147 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:34:17.532517 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:17.545394 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:34:17.624546 tst ping_idle_ping.py: using LAC 31020 19:34:17.750648 tst ping_idle_ping.py: using RAC 165 19:34:17.875573 tst ping_idle_ping.py: using CellId 31020 19:34:18.000299 tst ping_idle_ping.py: using BVCI 31021 19:34:18.116861 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:18.128575 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:18.140010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:18.152556 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:18.166186 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:18.177246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:18.188108 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:34:18.199060 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:34:18.313785 tst ping_idle_ping.py:24: start network... 19:34:18.514267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:18.983493 run create_hlr_db(pid=19501): Launched 19:34:19.097605 bus /gobi_6: Setting Powered False 19:34:20.157625 run create_hlr_db(pid=19501): Terminated: ok {rc=0} 19:34:20.574054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19503): Launched 19:34:20.871313 run osmo-hlr_10.42.42.2(pid=19504): Launched 19:34:20.986329 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:21.512661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19506): Launched 19:34:21.810469 run osmo-stp_10.42.42.5(pid=19507): Launched 19:34:21.924352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:22.439045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19509): Launched 19:34:22.552377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:22.803522 run patchelf(pid=19510): Launched 19:34:22.968847 run osmo-stp_10.42.42.5(pid=19507): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19507)] 19:34:23.094610 run osmo-stp_10.42.42.5(pid=19507): stdout: | (launched: 2022-12-12_19:34:21.755563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:23.222265 run osmo-stp_10.42.42.5(pid=19507): stderr: | 20221212193421924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193421925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193421925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193421925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193421926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193421926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193421926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:23.349769 run osmo-stp_10.42.42.5(pid=19507): stdout: | (launched: 2022-12-12_19:34:21.755563) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:23.472325 run osmo-stp_10.42.42.5(pid=19507): stderr: | 20221212193421924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193421925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193421925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193421925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193421926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193421926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193421926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:23.616375 run patchelf(pid=19510): Terminating (SIGINT) 19:34:23.782238 run patchelf(pid=19510): Terminated: ok {rc=0} 19:34:23.901837 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19507): Process ended prematurely: osmo-stp_10.42.42.5(pid=19507) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19507)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:34:23.910635 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:34:23.936926 run osmo-hlr_10.42.42.2(pid=19504): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19504)] 19:34:23.984544 run osmo-hlr_10.42.42.2(pid=19504): stdout: | (launched: 2022-12-12_19:34:20.816483) 19:34:24.033746 run osmo-hlr_10.42.42.2(pid=19504): stderr: | 20221212193420991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193420991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193420991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193420991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193420991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193420991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193421003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193421012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193421012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193421012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:24.083479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19503): Terminating (SIGTERM) 19:34:24.123009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19506): Terminating (SIGTERM) 19:34:24.162440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19509): Terminating (SIGTERM) 19:34:24.202056 --- ParallelTerminationStrategy: PID 19503 died... 19:34:24.221130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19503): Terminated: ok {rc=0} 19:34:24.265105 --- ParallelTerminationStrategy: PID 19506 died... 19:34:24.283708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19506): Terminated: ok {rc=0} 19:34:24.327120 --- ParallelTerminationStrategy: PID 19509 died... 19:34:24.345736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19509): Terminated: ok {rc=0} 19:34:24.428526 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:34:25.732075 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:34:25.737957 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:34:25.770802 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:34:25.808672 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:34:25.894921 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:34:25.927244 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:34:25.965312 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:34:26.559168 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:34:26.608071 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:26.618985 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:34:26.687523 tst cs_paging_gprs_active.py: using LAC 31021 19:34:26.805544 tst cs_paging_gprs_active.py: using RAC 166 19:34:26.928404 tst cs_paging_gprs_active.py: using CellId 31021 19:34:27.057552 tst cs_paging_gprs_active.py: using BVCI 31022 19:34:27.169062 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.179851 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.190680 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.201373 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.211936 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.222585 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.233330 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.243881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:27.254725 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:34:27.375692 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:34:27.493724 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:34:27.698883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:28.005397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19514): Launched 19:34:28.271722 run iperf3-srv_10.42.42.10(pid=19515): Launched 19:34:28.385564 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:34:28.588550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:28.893935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19516): Launched 19:34:29.161645 run iperf3-srv_10.42.42.10(pid=19517): Launched 19:34:29.275268 tst cs_paging_gprs_active.py:38: start network... 19:34:29.477777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:29.947015 run create_hlr_db(pid=19518): Launched 19:34:30.071233 bus /gobi_6: Setting Powered False 19:34:31.146583 run create_hlr_db(pid=19518): Terminated: ok {rc=0} 19:34:31.712481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19520): Launched 19:34:32.056404 run osmo-hlr_10.42.42.2(pid=19521): Launched 19:34:32.216879 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:32.793758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19523): Launched 19:34:33.122012 run osmo-stp_10.42.42.5(pid=19524): Launched 19:34:33.247789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:33.809327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19526): Launched 19:34:33.934624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:34.210307 run patchelf(pid=19527): Launched 19:34:34.394489 run osmo-stp_10.42.42.5(pid=19524): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19524)] 19:34:34.534104 run osmo-stp_10.42.42.5(pid=19524): stdout: | (launched: 2022-12-12_19:34:33.062677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:34.673648 run osmo-stp_10.42.42.5(pid=19524): stderr: | 20221212193433251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193433251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193433252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193433252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193433252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193433253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193433253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:34.813403 run osmo-stp_10.42.42.5(pid=19524): stdout: | (launched: 2022-12-12_19:34:33.062677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:34.947465 run osmo-stp_10.42.42.5(pid=19524): stderr: | 20221212193433251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193433251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193433252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193433252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193433252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193433253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193433253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:35.106007 run patchelf(pid=19527): Terminating (SIGINT) 19:34:35.288796 run patchelf(pid=19527): Terminated: ok {rc=0} 19:34:35.420612 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19524): Process ended prematurely: osmo-stp_10.42.42.5(pid=19524) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19524)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:34:35.430952 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:34:35.460176 run osmo-hlr_10.42.42.2(pid=19521): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19521)] 19:34:35.510864 run osmo-hlr_10.42.42.2(pid=19521): stdout: | (launched: 2022-12-12_19:34:31.995367) 19:34:35.563460 run osmo-hlr_10.42.42.2(pid=19521): stderr: | 20221212193432332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193432332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193432332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193432332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193432332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193432332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193432346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193432355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193432356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193432356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:35.616240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19514): Terminating (SIGTERM) 19:34:35.658634 run iperf3-srv_10.42.42.10(pid=19515): Terminating (SIGTERM) 19:34:35.700914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19516): Terminating (SIGTERM) 19:34:35.743199 run iperf3-srv_10.42.42.10(pid=19517): Terminating (SIGTERM) 19:34:35.786558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19520): Terminating (SIGTERM) 19:34:35.828939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19523): Terminating (SIGTERM) 19:34:35.871471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19526): Terminating (SIGTERM) 19:34:35.913681 --- ParallelTerminationStrategy: PID 19514 died... 19:34:35.933592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19514): Terminated: ok {rc=0} 19:34:35.980239 --- ParallelTerminationStrategy: PID 19515 died... 19:34:35.999697 run iperf3-srv_10.42.42.10(pid=19515): Terminated {rc=256} 19:34:36.046166 --- ParallelTerminationStrategy: PID 19516 died... 19:34:36.065638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19516): Terminated: ok {rc=0} 19:34:36.112180 --- ParallelTerminationStrategy: PID 19517 died... 19:34:36.131567 run iperf3-srv_10.42.42.10(pid=19517): Terminated {rc=256} 19:34:36.178001 --- ParallelTerminationStrategy: PID 19520 died... 19:34:36.197450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19520): Terminated: ok {rc=0} 19:34:36.244087 --- ParallelTerminationStrategy: PID 19523 died... 19:34:36.263547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19523): Terminated: ok {rc=0} 19:34:36.310057 --- ParallelTerminationStrategy: PID 19526 died... 19:34:36.329567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19526): Terminated: ok {rc=0} 19:34:36.418124 bus /gobi_0: Setting Powered False 19:34:37.517753 bus /gobi_0: Setting Powered False 19:34:38.634508 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:34:39.783183 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:39.795461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:34:39.871169 tst iperf3.py: using LAC 31022 19:34:39.998193 tst iperf3.py: using RAC 167 19:34:40.126308 tst iperf3.py: using CellId 31022 19:34:40.252562 tst iperf3.py: using BVCI 31023 19:34:40.370150 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.381852 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.393182 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.404659 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.416282 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.427973 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.439731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.451025 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:40.462707 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:34:40.579878 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:34:40.783533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:41.087677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19533): Launched 19:34:41.352521 run iperf3-srv_10.42.42.10(pid=19534): Launched 19:34:41.465800 tst iperf3.py:8: start network... 19:34:41.668443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:42.136351 run create_hlr_db(pid=19535): Launched 19:34:42.260492 bus /gobi_6: Setting Powered False 19:34:43.321503 run create_hlr_db(pid=19535): Terminated: ok {rc=0} 19:34:43.743488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19537): Launched 19:34:44.046303 run osmo-hlr_10.42.42.2(pid=19538): Launched 19:34:44.161080 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:44.681375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19540): Launched 19:34:44.983204 run osmo-stp_10.42.42.5(pid=19541): Launched 19:34:45.097763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:45.618674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19543): Launched 19:34:45.734291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:46.027387 run patchelf(pid=19544): Launched 19:34:46.228387 run osmo-stp_10.42.42.5(pid=19541): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19541)] 19:34:46.359102 run osmo-stp_10.42.42.5(pid=19541): stdout: | (launched: 2022-12-12_19:34:44.927183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:46.492786 run osmo-stp_10.42.42.5(pid=19541): stderr: | 20221212193445096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193445096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193445096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193445097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193445097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193445097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193445098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:46.625730 run osmo-stp_10.42.42.5(pid=19541): stdout: | (launched: 2022-12-12_19:34:44.927183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:46.752076 run osmo-stp_10.42.42.5(pid=19541): stderr: | 20221212193445096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193445096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193445096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193445097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193445097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193445097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193445098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:46.904389 run patchelf(pid=19544): Terminating (SIGINT) 19:34:47.077488 run patchelf(pid=19544): Terminated: ok {rc=0} 19:34:47.201561 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19541): Process ended prematurely: osmo-stp_10.42.42.5(pid=19541) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19541)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 19:34:47.211577 tst iperf3.py:8: Test FAILED (7.5 sec) 19:34:47.239398 run osmo-hlr_10.42.42.2(pid=19538): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19538)] 19:34:47.287528 run osmo-hlr_10.42.42.2(pid=19538): stdout: | (launched: 2022-12-12_19:34:43.989970) 19:34:47.337692 run osmo-hlr_10.42.42.2(pid=19538): stderr: | 20221212193444166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193444166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193444166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193444166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193444166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193444166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193444181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193444191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193444191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193444191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:47.387848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19533): Terminating (SIGTERM) 19:34:47.427555 run iperf3-srv_10.42.42.10(pid=19534): Terminating (SIGTERM) 19:34:47.467073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19537): Terminating (SIGTERM) 19:34:47.506757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19540): Terminating (SIGTERM) 19:34:47.546564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19543): Terminating (SIGTERM) 19:34:47.586347 --- ParallelTerminationStrategy: PID 19533 died... 19:34:47.605429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19533): Terminated: ok {rc=0} 19:34:47.649954 --- ParallelTerminationStrategy: PID 19534 died... 19:34:47.668378 run iperf3-srv_10.42.42.10(pid=19534): Terminated {rc=256} 19:34:47.712134 --- ParallelTerminationStrategy: PID 19537 died... 19:34:47.730761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19537): Terminated: ok {rc=0} 19:34:47.774552 --- ParallelTerminationStrategy: PID 19540 died... 19:34:47.793172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19540): Terminated: ok {rc=0} 19:34:47.837609 --- ParallelTerminationStrategy: PID 19543 died... 19:34:47.856092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19543): Terminated: ok {rc=0} 19:34:47.942821 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:34:49.091884 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.103628 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:34:49.176068 tst iperf3m4.py: using LAC 31023 19:34:49.295205 tst iperf3m4.py: using RAC 168 19:34:49.415238 tst iperf3m4.py: using CellId 31023 19:34:49.535089 tst iperf3m4.py: using BVCI 31024 19:34:49.646243 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.657418 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.668263 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.679080 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.689900 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.700783 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.711713 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.722483 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:34:49.733491 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:34:49.853670 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:34:49.973469 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:34:50.094277 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:34:50.216274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:34:50.436625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:50.764181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19545): Launched 19:34:51.048395 run iperf3-srv_10.42.42.10(pid=19546): Launched 19:34:51.170454 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:34:51.390609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:51.718174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19547): Launched 19:34:52.002701 run iperf3-srv_10.42.42.10(pid=19548): Launched 19:34:52.124493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:34:52.344299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:52.671159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19549): Launched 19:34:52.954660 run iperf3-srv_10.42.42.10(pid=19550): Launched 19:34:53.076324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:34:53.295041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:53.621550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19551): Launched 19:34:53.905395 run iperf3-srv_10.42.42.10(pid=19552): Launched 19:34:54.027133 tst iperf3m4.py:8: start network... 19:34:54.245743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:54.749651 run create_hlr_db(pid=19553): Launched 19:34:54.874480 bus /gobi_6: Setting Powered False 19:34:55.938461 run create_hlr_db(pid=19553): Terminated: ok {rc=0} 19:34:56.390351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19555): Launched 19:34:56.714248 run osmo-hlr_10.42.42.2(pid=19556): Launched 19:34:56.837397 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:57.396592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19558): Launched 19:34:57.721103 run osmo-stp_10.42.42.5(pid=19559): Launched 19:34:57.844868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:34:58.405085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19561): Launched 19:34:58.529621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:34:58.803948 run patchelf(pid=19562): Launched 19:34:58.984611 run osmo-stp_10.42.42.5(pid=19559): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19559)] 19:34:59.122529 run osmo-stp_10.42.42.5(pid=19559): stdout: | (launched: 2022-12-12_19:34:57.661670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:59.262284 run osmo-stp_10.42.42.5(pid=19559): stderr: | 20221212193457851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193457852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193457852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193457852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193457853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193457853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193457853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:59.402004 run osmo-stp_10.42.42.5(pid=19559): stdout: | (launched: 2022-12-12_19:34:57.661670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:59.535295 run osmo-stp_10.42.42.5(pid=19559): stderr: | 20221212193457851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193457852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193457852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193457852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193457853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193457853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193457853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:59.693063 run patchelf(pid=19562): Terminating (SIGINT) 19:34:59.875142 run patchelf(pid=19562): Terminated: ok {rc=0} 19:35:00.006547 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19559): Process ended prematurely: osmo-stp_10.42.42.5(pid=19559) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19559)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:35:00.016707 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:35:00.046330 run osmo-hlr_10.42.42.2(pid=19556): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19556)] 19:35:00.096921 run osmo-hlr_10.42.42.2(pid=19556): stdout: | (launched: 2022-12-12_19:34:56.654182) 19:35:00.149439 run osmo-hlr_10.42.42.2(pid=19556): stderr: | 20221212193456851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193456851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193456851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193456851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193456851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193456851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193456867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193456877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193456877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193456877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:00.202308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19545): Terminating (SIGTERM) 19:35:00.244804 run iperf3-srv_10.42.42.10(pid=19546): Terminating (SIGTERM) 19:35:00.287457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19547): Terminating (SIGTERM) 19:35:00.330167 run iperf3-srv_10.42.42.10(pid=19548): Terminating (SIGTERM) 19:35:00.372707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19549): Terminating (SIGTERM) 19:35:00.415429 run iperf3-srv_10.42.42.10(pid=19550): Terminating (SIGTERM) 19:35:00.458124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19551): Terminating (SIGTERM) 19:35:00.500607 run iperf3-srv_10.42.42.10(pid=19552): Terminating (SIGTERM) 19:35:00.543079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19555): Terminating (SIGTERM) 19:35:00.585805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19558): Terminating (SIGTERM) 19:35:00.628182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19561): Terminating (SIGTERM) 19:35:00.670887 --- ParallelTerminationStrategy: PID 19545 died... 19:35:00.691224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19545): Terminated: ok {rc=0} 19:35:00.738855 --- ParallelTerminationStrategy: PID 19546 died... 19:35:00.758712 run iperf3-srv_10.42.42.10(pid=19546): Terminated {rc=256} 19:35:00.806649 --- ParallelTerminationStrategy: PID 19547 died... 19:35:00.826736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19547): Terminated: ok {rc=0} 19:35:00.912007 --- ParallelTerminationStrategy: PID 19548 died... 19:35:00.932791 run iperf3-srv_10.42.42.10(pid=19548): Terminated {rc=256} 19:35:00.980766 --- ParallelTerminationStrategy: PID 19549 died... 19:35:01.014008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19549): Terminated: ok {rc=0} 19:35:01.072364 --- ParallelTerminationStrategy: PID 19550 died... 19:35:01.097681 run iperf3-srv_10.42.42.10(pid=19550): Terminated {rc=256} 19:35:01.163076 --- ParallelTerminationStrategy: PID 19551 died... 19:35:01.186473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19551): Terminated: ok {rc=0} 19:35:01.245701 --- ParallelTerminationStrategy: PID 19552 died... 19:35:01.270161 run iperf3-srv_10.42.42.10(pid=19552): Terminated {rc=256} 19:35:01.330658 --- ParallelTerminationStrategy: PID 19555 died... 19:35:01.352341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19555): Terminated: ok {rc=0} 19:35:01.400903 --- ParallelTerminationStrategy: PID 19558 died... 19:35:01.421361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19558): Terminated: ok {rc=0} 19:35:01.469753 --- ParallelTerminationStrategy: PID 19561 died... 19:35:01.490578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19561): Terminated: ok {rc=0} 19:35:01.581851 bus /gobi_4: Setting Powered False 19:35:02.682675 bus /gobi_4: Setting Powered False 19:35:03.799932 bus /gobi_1: Setting Powered False 19:35:04.901870 bus /gobi_1: Setting Powered False 19:35:06.019502 bus /gobi_0: Setting Powered False 19:35:07.119443 bus /gobi_0: Setting Powered False 19:35:08.238051 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:35:09.342646 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.355172 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:35:09.431330 tst ping.py: using LAC 31024 19:35:09.554911 tst ping.py: using RAC 169 19:35:09.677388 tst ping.py: using CellId 31024 19:35:09.799885 tst ping.py: using BVCI 31025 19:35:09.915938 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.927519 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.938807 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.950338 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.961839 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.973358 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.984928 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:09.996608 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:35:10.111477 tst ping.py:19: start network... 19:35:10.311312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:10.771568 run create_hlr_db(pid=19566): Launched 19:35:10.892937 bus /gobi_6: Setting Powered False 19:35:11.952903 run create_hlr_db(pid=19566): Terminated: ok {rc=0} 19:35:12.368776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19568): Launched 19:35:12.666854 run osmo-hlr_10.42.42.2(pid=19569): Launched 19:35:12.780727 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:13.304202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19571): Launched 19:35:13.601256 run osmo-stp_10.42.42.5(pid=19572): Launched 19:35:13.714251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:14.226516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19574): Launched 19:35:14.339392 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:14.590022 run patchelf(pid=19575): Launched 19:35:14.754231 run osmo-stp_10.42.42.5(pid=19572): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19572)] 19:35:14.879816 run osmo-stp_10.42.42.5(pid=19572): stdout: | (launched: 2022-12-12_19:35:13.546532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:15.006951 run osmo-stp_10.42.42.5(pid=19572): stderr: | 20221212193513716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193513716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193513717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193513717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193513717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193513718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193513718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:15.134259 run osmo-stp_10.42.42.5(pid=19572): stdout: | (launched: 2022-12-12_19:35:13.546532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:15.255442 run osmo-stp_10.42.42.5(pid=19572): stderr: | 20221212193513716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193513716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193513717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193513717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193513717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193513718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193513718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:15.398794 run patchelf(pid=19575): Terminating (SIGINT) 19:35:15.564859 run patchelf(pid=19575): Terminated: ok {rc=0} 19:35:15.684285 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19572): Process ended prematurely: osmo-stp_10.42.42.5(pid=19572) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19572)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 19:35:15.693209 tst ping.py:22: Test FAILED (6.3 sec) 19:35:15.719742 run osmo-hlr_10.42.42.2(pid=19569): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19569)] 19:35:15.767069 run osmo-hlr_10.42.42.2(pid=19569): stdout: | (launched: 2022-12-12_19:35:12.611738) 19:35:15.816236 run osmo-hlr_10.42.42.2(pid=19569): stderr: | 20221212193512787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193512788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193512788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193512788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193512788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193512788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193512800 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193512809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193512809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193512809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:15.881219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19568): Terminating (SIGTERM) 19:35:15.932342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19571): Terminating (SIGTERM) 19:35:15.973660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19574): Terminating (SIGTERM) 19:35:16.016639 --- ParallelTerminationStrategy: PID 19568 died... 19:35:16.037393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19568): Terminated: ok {rc=0} 19:35:16.085752 --- ParallelTerminationStrategy: PID 19571 died... 19:35:16.105308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19571): Terminated: ok {rc=0} 19:35:16.151384 --- ParallelTerminationStrategy: PID 19574 died... 19:35:16.170428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19574): Terminated: ok {rc=0} 19:35:16.254315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:35:17.338639 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.350446 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:35:17.421039 tst ping_idle_ping.py: using LAC 31025 19:35:17.538451 tst ping_idle_ping.py: using RAC 170 19:35:17.656699 tst ping_idle_ping.py: using CellId 31025 19:35:17.772582 tst ping_idle_ping.py: using BVCI 31026 19:35:17.880891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.892117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.902946 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.913779 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.924510 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.935152 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.945898 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:35:17.956442 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:35:18.074456 tst ping_idle_ping.py:24: start network... 19:35:18.291203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:18.788187 run create_hlr_db(pid=19576): Launched 19:35:18.910389 bus /gobi_6: Setting Powered False 19:35:19.974004 run create_hlr_db(pid=19576): Terminated: ok {rc=0} 19:35:20.400883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19578): Launched 19:35:20.721324 run osmo-hlr_10.42.42.2(pid=19579): Launched 19:35:20.843030 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:21.393612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19581): Launched 19:35:21.712717 run osmo-stp_10.42.42.5(pid=19582): Launched 19:35:21.834715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:22.385656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19584): Launched 19:35:22.509572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:22.779567 run patchelf(pid=19585): Launched 19:35:22.958575 run osmo-stp_10.42.42.5(pid=19582): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19582)] 19:35:23.094072 run osmo-stp_10.42.42.5(pid=19582): stdout: | (launched: 2022-12-12_19:35:21.654316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:23.231365 run osmo-stp_10.42.42.5(pid=19582): stderr: | 20221212193521845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193521845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193521845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193521846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193521846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193521846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193521846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:23.368818 run osmo-stp_10.42.42.5(pid=19582): stdout: | (launched: 2022-12-12_19:35:21.654316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:23.499706 run osmo-stp_10.42.42.5(pid=19582): stderr: | 20221212193521845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193521845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193521845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193521846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193521846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193521846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193521846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:23.655348 run patchelf(pid=19585): Terminating (SIGINT) 19:35:23.833651 run patchelf(pid=19585): Terminated: ok {rc=0} 19:35:23.962853 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19582): Process ended prematurely: osmo-stp_10.42.42.5(pid=19582) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19582)] [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:35:23.972418 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:35:24.001445 run osmo-hlr_10.42.42.2(pid=19579): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19579)] 19:35:24.051558 run osmo-hlr_10.42.42.2(pid=19579): stdout: | (launched: 2022-12-12_19:35:20.662986) 19:35:24.103758 run osmo-hlr_10.42.42.2(pid=19579): stderr: | 20221212193520859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193520859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193520859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193520859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193520859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193520859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193520871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193520879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193520879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193520879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:24.156351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19578): Terminating (SIGTERM) 19:35:24.198423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19581): Terminating (SIGTERM) 19:35:24.240467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19584): Terminating (SIGTERM) 19:35:24.282698 --- ParallelTerminationStrategy: PID 19578 died... 19:35:24.302720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19578): Terminated: ok {rc=0} 19:35:24.349718 --- ParallelTerminationStrategy: PID 19581 died... 19:35:24.369305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19581): Terminated: ok {rc=0} 19:35:24.415863 --- ParallelTerminationStrategy: PID 19584 died... 19:35:24.435422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19584): Terminated: ok {rc=0} 19:35:24.522620 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:35:25.831313 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:35:25.838425 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:35:25.873758 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:35:25.914054 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:35:26.003882 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:35:26.038484 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:35:26.078481 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:35:26.678672 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:35:26.731811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:26.743804 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:35:26.797835 tst cs_paging_gprs_active.py: using LAC 31026 19:35:26.930599 tst cs_paging_gprs_active.py: using RAC 171 19:35:27.050479 tst cs_paging_gprs_active.py: using CellId 31026 19:35:27.170214 tst cs_paging_gprs_active.py: using BVCI 31027 19:35:27.282822 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.294421 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.305705 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.317407 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.329002 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.340593 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.352377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.363903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:27.375716 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:35:27.495613 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:35:27.616356 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:35:27.823136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:28.129781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19589): Launched 19:35:28.395510 run iperf3-srv_10.42.42.10(pid=19590): Launched 19:35:28.509869 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:35:28.713412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:29.019972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19591): Launched 19:35:29.286659 run iperf3-srv_10.42.42.10(pid=19592): Launched 19:35:29.402605 tst cs_paging_gprs_active.py:38: start network... 19:35:29.605969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:30.076399 run create_hlr_db(pid=19593): Launched 19:35:30.200098 bus /gobi_6: Setting Powered False 19:35:31.273942 run create_hlr_db(pid=19593): Terminated: ok {rc=0} 19:35:31.741733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19595): Launched 19:35:32.092601 run osmo-hlr_10.42.42.2(pid=19596): Launched 19:35:32.217917 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:32.754461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19598): Launched 19:35:33.060797 run osmo-stp_10.42.42.5(pid=19599): Launched 19:35:33.175744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:33.697526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19601): Launched 19:35:33.814052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:34.071636 run patchelf(pid=19602): Launched 19:35:34.240849 run osmo-stp_10.42.42.5(pid=19599): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19599)] 19:35:34.370022 run osmo-stp_10.42.42.5(pid=19599): stdout: | (launched: 2022-12-12_19:35:33.004776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:34.501963 run osmo-stp_10.42.42.5(pid=19599): stderr: | 20221212193533175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193533176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193533176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193533176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193533177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193533177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193533177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:34.632568 run osmo-stp_10.42.42.5(pid=19599): stdout: | (launched: 2022-12-12_19:35:33.004776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:34.756927 run osmo-stp_10.42.42.5(pid=19599): stderr: | 20221212193533175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193533176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193533176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193533176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193533177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193533177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193533177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:34.904222 run patchelf(pid=19602): Terminating (SIGINT) 19:35:35.074756 run patchelf(pid=19602): Terminated: ok {rc=0} 19:35:35.197434 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19599): Process ended prematurely: osmo-stp_10.42.42.5(pid=19599) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19599)] [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:35:35.206865 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 19:35:35.234187 run osmo-hlr_10.42.42.2(pid=19596): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19596)] 19:35:35.282094 run osmo-hlr_10.42.42.2(pid=19596): stdout: | (launched: 2022-12-12_19:35:32.024323) 19:35:35.331706 run osmo-hlr_10.42.42.2(pid=19596): stderr: | 20221212193532271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193532271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193532271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193532271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193532271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193532271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193532283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193532293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193532293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193532294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:35.381893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19589): Terminating (SIGTERM) 19:35:35.422184 run iperf3-srv_10.42.42.10(pid=19590): Terminating (SIGTERM) 19:35:35.462416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19591): Terminating (SIGTERM) 19:35:35.502663 run iperf3-srv_10.42.42.10(pid=19592): Terminating (SIGTERM) 19:35:35.542895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19595): Terminating (SIGTERM) 19:35:35.583057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19598): Terminating (SIGTERM) 19:35:35.623168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19601): Terminating (SIGTERM) 19:35:35.663375 --- ParallelTerminationStrategy: PID 19589 died... 19:35:35.682604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19589): Terminated: ok {rc=0} 19:35:35.727291 --- ParallelTerminationStrategy: PID 19590 died... 19:35:35.746164 run iperf3-srv_10.42.42.10(pid=19590): Terminated {rc=256} 19:35:35.790478 --- ParallelTerminationStrategy: PID 19591 died... 19:35:35.809436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19591): Terminated: ok {rc=0} 19:35:35.853790 --- ParallelTerminationStrategy: PID 19592 died... 19:35:35.872594 run iperf3-srv_10.42.42.10(pid=19592): Terminated {rc=256} 19:35:35.917234 --- ParallelTerminationStrategy: PID 19595 died... 19:35:35.936080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19595): Terminated: ok {rc=0} 19:35:35.980341 --- ParallelTerminationStrategy: PID 19598 died... 19:35:35.999261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19598): Terminated: ok {rc=0} 19:35:36.044316 --- ParallelTerminationStrategy: PID 19601 died... 19:35:36.063335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19601): Terminated: ok {rc=0} 19:35:36.150356 bus /gobi_0: Setting Powered False 19:35:37.251324 bus /gobi_0: Setting Powered False 19:35:38.368515 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:35:39.515998 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:39.528188 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:35:39.583978 tst iperf3.py: using LAC 31027 19:35:39.704667 tst iperf3.py: using RAC 172 19:35:39.833452 tst iperf3.py: using CellId 31027 19:35:39.952854 tst iperf3.py: using BVCI 31028 19:35:40.063332 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.075001 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.086487 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.098056 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.109636 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.120938 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.132541 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.143799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:40.155177 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:35:40.273712 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:35:40.494488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:40.822363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19603): Launched 19:35:41.107846 run iperf3-srv_10.42.42.10(pid=19604): Launched 19:35:41.230382 tst iperf3.py:8: start network... 19:35:41.450213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:41.954046 run create_hlr_db(pid=19605): Launched 19:35:42.079921 bus /gobi_6: Setting Powered False 19:35:43.144697 run create_hlr_db(pid=19605): Terminated: ok {rc=0} 19:35:43.577447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19607): Launched 19:35:43.882457 run osmo-hlr_10.42.42.2(pid=19608): Launched 19:35:44.000287 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:44.527388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19610): Launched 19:35:44.829104 run osmo-stp_10.42.42.5(pid=19611): Launched 19:35:44.944534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:45.483662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19613): Launched 19:35:45.599510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:45.874852 run patchelf(pid=19614): Launched 19:35:46.086842 run osmo-stp_10.42.42.5(pid=19611): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19611)] 19:35:46.232196 run osmo-stp_10.42.42.5(pid=19611): stdout: | (launched: 2022-12-12_19:35:44.773423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:46.376769 run osmo-stp_10.42.42.5(pid=19611): stderr: | 20221212193544943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193544943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193544944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193544944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193544945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193544945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193544945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:46.522605 run osmo-stp_10.42.42.5(pid=19611): stdout: | (launched: 2022-12-12_19:35:44.773423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:46.659904 run osmo-stp_10.42.42.5(pid=19611): stderr: | 20221212193544943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193544943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193544944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193544944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193544945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193544945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193544945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:46.850670 run patchelf(pid=19614): Terminating (SIGINT) 19:35:47.048498 run patchelf(pid=19614): Terminated: ok {rc=0} 19:35:47.184403 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19611): Process ended prematurely: osmo-stp_10.42.42.5(pid=19611) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19611)] [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:35:47.195564 tst iperf3.py:8: Test FAILED (7.7 sec) 19:35:47.227188 run osmo-hlr_10.42.42.2(pid=19608): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19608)] 19:35:47.277945 run osmo-hlr_10.42.42.2(pid=19608): stdout: | (launched: 2022-12-12_19:35:43.826479) 19:35:47.330555 run osmo-hlr_10.42.42.2(pid=19608): stderr: | 20221212193544001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193544001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193544001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193544001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193544001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193544001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193544014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193544022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193544022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193544022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:47.383472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19603): Terminating (SIGTERM) 19:35:47.426107 run iperf3-srv_10.42.42.10(pid=19604): Terminating (SIGTERM) 19:35:47.468361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19607): Terminating (SIGTERM) 19:35:47.510875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19610): Terminating (SIGTERM) 19:35:47.553124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19613): Terminating (SIGTERM) 19:35:47.595564 --- ParallelTerminationStrategy: PID 19603 died... 19:35:47.615687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19603): Terminated: ok {rc=0} 19:35:47.663050 --- ParallelTerminationStrategy: PID 19604 died... 19:35:47.682735 run iperf3-srv_10.42.42.10(pid=19604): Terminated {rc=256} 19:35:47.729441 --- ParallelTerminationStrategy: PID 19607 died... 19:35:47.749123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19607): Terminated: ok {rc=0} 19:35:47.795999 --- ParallelTerminationStrategy: PID 19610 died... 19:35:47.815737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19610): Terminated: ok {rc=0} 19:35:47.862862 --- ParallelTerminationStrategy: PID 19613 died... 19:35:47.882543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19613): Terminated: ok {rc=0} 19:35:47.971479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:35:49.121066 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.133792 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:35:49.188199 tst iperf3m4.py: using LAC 31028 19:35:49.316282 tst iperf3m4.py: using RAC 173 19:35:49.442434 tst iperf3m4.py: using CellId 31028 19:35:49.570543 tst iperf3m4.py: using BVCI 31029 19:35:49.689891 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.701802 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.713530 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.725547 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.737602 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.749720 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.761920 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.773778 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:35:49.786013 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:35:49.904237 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:35:50.021928 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:35:50.141905 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:35:50.259693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:35:50.478752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:50.804654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19617): Launched 19:35:51.087399 run iperf3-srv_10.42.42.10(pid=19618): Launched 19:35:51.210814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:35:51.429898 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:51.756261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19619): Launched 19:35:52.039832 run iperf3-srv_10.42.42.10(pid=19620): Launched 19:35:52.162041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:35:52.380697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:52.708127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19621): Launched 19:35:52.992164 run iperf3-srv_10.42.42.10(pid=19622): Launched 19:35:53.114018 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:35:53.332585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:53.659061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19623): Launched 19:35:53.944046 run iperf3-srv_10.42.42.10(pid=19624): Launched 19:35:54.065825 tst iperf3m4.py:8: start network... 19:35:54.285386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:54.789084 run create_hlr_db(pid=19625): Launched 19:35:54.915316 bus /gobi_6: Setting Powered False 19:35:55.979032 run create_hlr_db(pid=19625): Terminated: ok {rc=0} 19:35:56.430367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19627): Launched 19:35:56.755873 run osmo-hlr_10.42.42.2(pid=19628): Launched 19:35:56.880173 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:57.445532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19630): Launched 19:35:57.771095 run osmo-stp_10.42.42.5(pid=19631): Launched 19:35:57.897036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:58.457099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19633): Launched 19:35:58.581096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:58.855053 run patchelf(pid=19634): Launched 19:35:59.035738 run osmo-stp_10.42.42.5(pid=19631): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19631)] 19:35:59.173772 run osmo-stp_10.42.42.5(pid=19631): stdout: | (launched: 2022-12-12_19:35:57.711813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:59.312777 run osmo-stp_10.42.42.5(pid=19631): stderr: | 20221212193557901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193557901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193557902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193557902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193557903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193557903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193557903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:59.452045 run osmo-stp_10.42.42.5(pid=19631): stdout: | (launched: 2022-12-12_19:35:57.711813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:59.585112 run osmo-stp_10.42.42.5(pid=19631): stderr: | 20221212193557901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193557901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193557902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193557902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193557903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193557903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193557903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:59.742457 run patchelf(pid=19634): Terminating (SIGINT) 19:35:59.924408 run patchelf(pid=19634): Terminated: ok {rc=0} 19:36:00.055972 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19631): Process ended prematurely: osmo-stp_10.42.42.5(pid=19631) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19631)] [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:36:00.066395 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:36:00.095748 run osmo-hlr_10.42.42.2(pid=19628): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19628)] 19:36:00.146421 run osmo-hlr_10.42.42.2(pid=19628): stdout: | (launched: 2022-12-12_19:35:56.696282) 19:36:00.199175 run osmo-hlr_10.42.42.2(pid=19628): stderr: | 20221212193556892 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193556892 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193556892 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193556893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193556893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193556893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193556908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193556916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193556917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193556917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:00.252359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19617): Terminating (SIGTERM) 19:36:00.294603 run iperf3-srv_10.42.42.10(pid=19618): Terminating (SIGTERM) 19:36:00.336803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19619): Terminating (SIGTERM) 19:36:00.379120 run iperf3-srv_10.42.42.10(pid=19620): Terminating (SIGTERM) 19:36:00.421266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19621): Terminating (SIGTERM) 19:36:00.463614 run iperf3-srv_10.42.42.10(pid=19622): Terminating (SIGTERM) 19:36:00.506266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19623): Terminating (SIGTERM) 19:36:00.548631 run iperf3-srv_10.42.42.10(pid=19624): Terminating (SIGTERM) 19:36:00.590738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19627): Terminating (SIGTERM) 19:36:00.632898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19630): Terminating (SIGTERM) 19:36:00.675191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19633): Terminating (SIGTERM) 19:36:00.717596 --- ParallelTerminationStrategy: PID 19617 died... 19:36:00.737839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19617): Terminated: ok {rc=0} 19:36:00.785628 --- ParallelTerminationStrategy: PID 19618 died... 19:36:00.805253 run iperf3-srv_10.42.42.10(pid=19618): Terminated {rc=256} 19:36:00.853382 --- ParallelTerminationStrategy: PID 19619 died... 19:36:00.873967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19619): Terminated: ok {rc=0} 19:36:00.924383 --- ParallelTerminationStrategy: PID 19620 died... 19:36:00.944632 run iperf3-srv_10.42.42.10(pid=19620): Terminated {rc=256} 19:36:00.992423 --- ParallelTerminationStrategy: PID 19621 died... 19:36:01.012585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19621): Terminated: ok {rc=0} 19:36:01.060124 --- ParallelTerminationStrategy: PID 19622 died... 19:36:01.080441 run iperf3-srv_10.42.42.10(pid=19622): Terminated {rc=256} 19:36:01.128356 --- ParallelTerminationStrategy: PID 19623 died... 19:36:01.148695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19623): Terminated: ok {rc=0} 19:36:01.196395 --- ParallelTerminationStrategy: PID 19624 died... 19:36:01.216467 run iperf3-srv_10.42.42.10(pid=19624): Terminated {rc=256} 19:36:01.263398 --- ParallelTerminationStrategy: PID 19627 died... 19:36:01.283432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19627): Terminated: ok {rc=0} 19:36:01.330640 --- ParallelTerminationStrategy: PID 19630 died... 19:36:01.350829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19630): Terminated: ok {rc=0} 19:36:01.398156 --- ParallelTerminationStrategy: PID 19633 died... 19:36:01.418094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19633): Terminated: ok {rc=0} 19:36:01.507912 bus /gobi_4: Setting Powered False 19:36:02.607315 bus /gobi_4: Setting Powered False 19:36:03.722418 bus /gobi_1: Setting Powered False 19:36:04.821787 bus /gobi_1: Setting Powered False 19:36:05.937995 bus /gobi_0: Setting Powered False 19:36:07.035264 bus /gobi_0: Setting Powered False 19:36:08.154685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:36:09.259360 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.271901 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:36:09.327046 tst ping.py: using LAC 31029 19:36:09.452209 tst ping.py: using RAC 174 19:36:09.581194 tst ping.py: using CellId 31029 19:36:09.704571 tst ping.py: using BVCI 31030 19:36:09.819674 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.831521 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.843177 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.855066 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.866824 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.878558 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.890593 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:09.902853 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:36:10.019532 tst ping.py:19: start network... 19:36:10.219529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:10.680379 run create_hlr_db(pid=19635): Launched 19:36:10.802755 bus /gobi_6: Setting Powered False 19:36:11.863140 run create_hlr_db(pid=19635): Terminated: ok {rc=0} 19:36:12.299283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19637): Launched 19:36:12.618497 run osmo-hlr_10.42.42.2(pid=19638): Launched 19:36:12.742549 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:13.294398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19640): Launched 19:36:13.612857 run osmo-stp_10.42.42.5(pid=19641): Launched 19:36:13.735589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:14.287225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19643): Launched 19:36:14.410618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:14.680254 run patchelf(pid=19644): Launched 19:36:14.857548 run osmo-stp_10.42.42.5(pid=19641): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19641)] 19:36:14.993609 run osmo-stp_10.42.42.5(pid=19641): stdout: | (launched: 2022-12-12_19:36:13.554558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:15.130667 run osmo-stp_10.42.42.5(pid=19641): stderr: | 20221212193613744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193613745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193613745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193613745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193613746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193613746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193613746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:15.267807 run osmo-stp_10.42.42.5(pid=19641): stdout: | (launched: 2022-12-12_19:36:13.554558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:15.399066 run osmo-stp_10.42.42.5(pid=19641): stderr: | 20221212193613744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193613745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193613745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193613745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193613746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193613746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193613746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:15.554852 run patchelf(pid=19644): Terminating (SIGINT) 19:36:15.732935 run patchelf(pid=19644): Terminated: ok {rc=0} 19:36:15.868074 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19641): Process ended prematurely: osmo-stp_10.42.42.5(pid=19641) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19641)] [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:36:15.878221 tst ping.py:22: Test FAILED (6.6 sec) 19:36:15.909310 run osmo-hlr_10.42.42.2(pid=19638): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19638)] 19:36:15.959024 run osmo-hlr_10.42.42.2(pid=19638): stdout: | (launched: 2022-12-12_19:36:12.560275) 19:36:16.009620 run osmo-hlr_10.42.42.2(pid=19638): stderr: | 20221212193612756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193612756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193612756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193612756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193612756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193612756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193612768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193612776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193612777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193612777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:16.061646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19637): Terminating (SIGTERM) 19:36:16.103997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19640): Terminating (SIGTERM) 19:36:16.147076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19643): Terminating (SIGTERM) 19:36:16.190335 --- ParallelTerminationStrategy: PID 19637 died... 19:36:16.210217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19637): Terminated: ok {rc=0} 19:36:16.257311 --- ParallelTerminationStrategy: PID 19640 died... 19:36:16.276693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19640): Terminated: ok {rc=0} 19:36:16.323034 --- ParallelTerminationStrategy: PID 19643 died... 19:36:16.342908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19643): Terminated: ok {rc=0} 19:36:16.430252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:36:17.534093 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:17.547386 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:36:17.603135 tst ping_idle_ping.py: using LAC 31030 19:36:17.731527 tst ping_idle_ping.py: using RAC 175 19:36:17.855521 tst ping_idle_ping.py: using CellId 31030 19:36:17.978914 tst ping_idle_ping.py: using BVCI 31031 19:36:18.094759 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:18.106762 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:18.118436 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:18.130414 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:18.142253 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:18.154182 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:18.166193 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:36:18.178332 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:36:18.294668 tst ping_idle_ping.py:24: start network... 19:36:18.496625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:18.961264 run create_hlr_db(pid=19645): Launched 19:36:19.083619 bus /gobi_6: Setting Powered False 19:36:20.143726 run create_hlr_db(pid=19645): Terminated: ok {rc=0} 19:36:20.562618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Launched 19:36:20.861297 run osmo-hlr_10.42.42.2(pid=19648): Launched 19:36:20.973866 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:21.486019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Launched 19:36:21.783447 run osmo-stp_10.42.42.5(pid=19651): Launched 19:36:21.896369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:22.429076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19653): Launched 19:36:22.552263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:22.823218 run patchelf(pid=19654): Launched 19:36:23.001482 run osmo-stp_10.42.42.5(pid=19651): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] 19:36:23.137175 run osmo-stp_10.42.42.5(pid=19651): stdout: | (launched: 2022-12-12_19:36:21.728582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:23.274587 run osmo-stp_10.42.42.5(pid=19651): stderr: | 20221212193621938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193621938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193621938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193621938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193621939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193621939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193621939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:23.412050 run osmo-stp_10.42.42.5(pid=19651): stdout: | (launched: 2022-12-12_19:36:21.728582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:23.543599 run osmo-stp_10.42.42.5(pid=19651): stderr: | 20221212193621938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193621938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193621938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193621938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193621939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193621939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193621939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:23.699500 run patchelf(pid=19654): Terminating (SIGINT) 19:36:23.877779 run patchelf(pid=19654): Terminated: ok {rc=0} 19:36:24.007050 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19651): Process ended prematurely: osmo-stp_10.42.42.5(pid=19651) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:36:24.016744 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:36:24.045530 run osmo-hlr_10.42.42.2(pid=19648): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19648)] 19:36:24.095916 run osmo-hlr_10.42.42.2(pid=19648): stdout: | (launched: 2022-12-12_19:36:20.806011) 19:36:24.148665 run osmo-hlr_10.42.42.2(pid=19648): stderr: | 20221212193620981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193620981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193620981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193620982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193620982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193620982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193620994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193621003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193621003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193621003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:24.198449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Terminating (SIGTERM) 19:36:24.237814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Terminating (SIGTERM) 19:36:24.277210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19653): Terminating (SIGTERM) 19:36:24.316765 --- ParallelTerminationStrategy: PID 19647 died... 19:36:24.335865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19647): Terminated: ok {rc=0} 19:36:24.379787 --- ParallelTerminationStrategy: PID 19650 died... 19:36:24.398830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19650): Terminated: ok {rc=0} 19:36:24.442964 --- ParallelTerminationStrategy: PID 19653 died... 19:36:24.461561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19653): Terminated: ok {rc=0} 19:36:24.548207 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:36:25.867531 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:36:25.875083 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:36:25.907756 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:36:25.942016 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:36:25.993246 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:36:26.026172 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:36:26.060425 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:36:26.618823 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:36:26.623688 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:26.634971 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:36:26.702406 tst switch_tch_pdch.py: using LAC 31031 19:36:26.817311 tst switch_tch_pdch.py: using RAC 176 19:36:26.942494 tst switch_tch_pdch.py: using CellId 31031 19:36:27.067283 tst switch_tch_pdch.py: using BVCI 31032 19:36:27.183067 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:27.195076 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:27.206904 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:27.219077 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:27.231737 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:27.243698 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:27.256181 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:36:27.268345 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:36:27.386561 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:36:27.506419 tst switch_tch_pdch.py:51: start network... 19:36:27.721763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:28.217213 run create_hlr_db(pid=19660): Launched 19:36:28.340156 bus /gobi_6: Setting Powered False 19:36:29.404053 run create_hlr_db(pid=19660): Terminated: ok {rc=0} 19:36:29.849668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Launched 19:36:30.170194 run osmo-hlr_10.42.42.2(pid=19663): Launched 19:36:30.293639 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:30.857705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Launched 19:36:31.198114 run osmo-stp_10.42.42.5(pid=19666): Launched 19:36:31.450136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:32.017196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Launched 19:36:32.146427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:32.403854 run patchelf(pid=19669): Launched 19:36:32.570321 run osmo-stp_10.42.42.5(pid=19666): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] 19:36:32.696291 run osmo-stp_10.42.42.5(pid=19666): stdout: | (launched: 2022-12-12_19:36:31.139391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:32.824774 run osmo-stp_10.42.42.5(pid=19666): stderr: | 20221212193631325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193631325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193631326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193631327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193631327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193631328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193631328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:32.952565 run osmo-stp_10.42.42.5(pid=19666): stdout: | (launched: 2022-12-12_19:36:31.139391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:33.074614 run osmo-stp_10.42.42.5(pid=19666): stderr: | 20221212193631325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193631325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193631326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193631327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193631327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193631328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193631328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:33.219199 run patchelf(pid=19669): Terminating (SIGINT) 19:36:33.386210 run patchelf(pid=19669): Terminated: ok {rc=0} 19:36:33.506279 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19666): Process ended prematurely: osmo-stp_10.42.42.5(pid=19666) [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:36:33.515123 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 19:36:33.541888 run osmo-hlr_10.42.42.2(pid=19663): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19663)] 19:36:33.589933 run osmo-hlr_10.42.42.2(pid=19663): stdout: | (launched: 2022-12-12_19:36:30.111939) 19:36:33.639658 run osmo-hlr_10.42.42.2(pid=19663): stderr: | 20221212193630308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193630308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193630308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193630308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193630308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193630308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193630320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193630328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193630329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193630329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:33.689742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Terminating (SIGTERM) 19:36:33.729972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Terminating (SIGTERM) 19:36:33.770138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Terminating (SIGTERM) 19:36:33.810582 --- ParallelTerminationStrategy: PID 19662 died... 19:36:33.829996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19662): Terminated: ok {rc=0} 19:36:33.874371 --- ParallelTerminationStrategy: PID 19665 died... 19:36:33.892939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19665): Terminated: ok {rc=0} 19:36:33.937337 --- ParallelTerminationStrategy: PID 19668 died... 19:36:33.956032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19668): Terminated: ok {rc=0} 19:36:34.042855 bus /gobi_0: Setting Powered False 19:36:35.144239 bus /gobi_0: Setting Powered False 19:36:36.264018 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:36:37.528059 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:36:37.534520 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:36:37.569593 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:36:37.605443 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:36:37.659424 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:36:37.692506 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:36:37.727358 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:36:38.282682 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:36:38.287632 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.298583 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:36:38.365974 tst switch_tch_pdch.py: using LAC 31032 19:36:38.481171 tst switch_tch_pdch.py: using RAC 177 19:36:38.596489 tst switch_tch_pdch.py: using CellId 31032 19:36:38.711246 tst switch_tch_pdch.py: using BVCI 31033 19:36:38.818348 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.829472 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.840223 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.851012 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.861862 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.872628 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.883520 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:36:38.894335 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:36:39.013287 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:36:39.132706 tst switch_tch_pdch.py:51: start network... 19:36:39.347102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:39.812852 run create_hlr_db(pid=19673): Launched 19:36:39.937430 bus /gobi_6: Setting Powered False 19:36:41.000904 run create_hlr_db(pid=19673): Terminated: ok {rc=0} 19:36:41.418568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19675): Launched 19:36:41.739595 run osmo-hlr_10.42.42.2(pid=19676): Launched 19:36:41.862832 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:42.382721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19678): Launched 19:36:42.702369 run osmo-stp_10.42.42.5(pid=19679): Launched 19:36:42.825571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:43.348268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19681): Launched 19:36:43.470510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:43.739316 run patchelf(pid=19682): Launched 19:36:43.917608 run osmo-stp_10.42.42.5(pid=19679): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19679)] 19:36:44.052490 run osmo-stp_10.42.42.5(pid=19679): stdout: | (launched: 2022-12-12_19:36:42.644025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:44.189743 run osmo-stp_10.42.42.5(pid=19679): stderr: | 20221212193642834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193642834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193642834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193642835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193642835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193642835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193642835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:44.326573 run osmo-stp_10.42.42.5(pid=19679): stdout: | (launched: 2022-12-12_19:36:42.644025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:44.457234 run osmo-stp_10.42.42.5(pid=19679): stderr: | 20221212193642834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193642834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193642834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193642835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193642835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193642835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193642835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:44.611781 run patchelf(pid=19682): Terminating (SIGINT) 19:36:44.790325 run patchelf(pid=19682): Terminated: ok {rc=0} 19:36:44.918564 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19679): Process ended prematurely: osmo-stp_10.42.42.5(pid=19679) [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19679)] [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:36:44.928447 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 19:36:44.957200 run osmo-hlr_10.42.42.2(pid=19676): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19676)] 19:36:45.007679 run osmo-hlr_10.42.42.2(pid=19676): stdout: | (launched: 2022-12-12_19:36:41.681062) 19:36:45.059936 run osmo-hlr_10.42.42.2(pid=19676): stderr: | 20221212193641875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193641875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193641876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193641876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193641876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193641876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193641927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193641937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193641937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193641937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:45.112780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19675): Terminating (SIGTERM) 19:36:45.154626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19678): Terminating (SIGTERM) 19:36:45.196604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19681): Terminating (SIGTERM) 19:36:45.238949 --- ParallelTerminationStrategy: PID 19675 died... 19:36:45.258506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19675): Terminated: ok {rc=0} 19:36:45.305119 --- ParallelTerminationStrategy: PID 19678 died... 19:36:45.324466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19678): Terminated: ok {rc=0} 19:36:45.371206 --- ParallelTerminationStrategy: PID 19681 died... 19:36:45.390714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19681): Terminated: ok {rc=0} 19:36:45.478601 bus /gobi_0: Setting Powered False 19:36:46.584409 bus /gobi_0: Setting Powered False 19:36:47.720215 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 19:36:48.973142 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:36:48.978332 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:36:49.014360 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 19:36:49.021519 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:36:49.075752 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:36:49.110374 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 19:36:49.117378 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:36:49.655825 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 19:36:49.661032 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 19:36:49.672292 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:36:49.722601 tst mo_mt_sms.py: using LAC 31033 19:36:49.848400 tst mo_mt_sms.py: using RAC 178 19:36:49.976724 tst mo_mt_sms.py: using CellId 31033 19:36:50.101528 tst mo_mt_sms.py: using BVCI 31034 19:36:50.209990 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:36:50.326902 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:36:50.439745 tst mo_mt_sms.py:9: start nitb and bts... 19:36:50.640214 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:36:51.246546 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19686): Launched 19:36:51.542761 run osmo-nitb_10.42.42.2(pid=19687): Launched 19:36:51.708495 run osmo-nitb_10.42.42.2(pid=19687): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19687)] 19:36:51.841971 run osmo-nitb_10.42.42.2(pid=19687): stdout: | (launched: 2022-12-12_19:36:51.488058) 19:36:51.976700 run osmo-nitb_10.42.42.2(pid=19687): stderr: | (launched: 2022-12-12_19:36:51.532095) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:36:52.111525 run osmo-nitb_10.42.42.2(pid=19687): stdout: | (launched: 2022-12-12_19:36:51.488058) 19:36:52.240365 run osmo-nitb_10.42.42.2(pid=19687): stderr: | (launched: 2022-12-12_19:36:51.532095) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19687): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19687) [trial-2381↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19687)] 19:36:52.656335 tst osmo-nitb_10.42.42.2(pid=19687): stdout: | (launched: 2022-12-12_19:36:51.488058) 19:36:52.775852 tst osmo-nitb_10.42.42.2(pid=19687): stderr: | (launched: 2022-12-12_19:36:51.532095) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:36:52.916390 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19687): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19687) [trial-2381↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19687)] [trial-2381↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 19:36:52.924775 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 19:36:52.931245 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19686): Terminating (SIGTERM) 19:36:53.139742 --- ParallelTerminationStrategy: PID 19686 died... 19:36:53.160337 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19686): Terminated: ok {rc=0} 19:36:53.244424 bus /sierra_3: Setting Powered False 19:36:54.345552 bus /sierra_3: Setting Powered False 19:36:55.463936 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:trx-sysmocell5000 --------------------------------------------------------------------- 19:36:56.665333 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:36:56.669672 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:36:56.704935 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:36:56.733719 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:36:56.790743 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:36:56.825862 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:36:56.853138 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:36:57.396795 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 19:36:57.402033 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:36:57.413210 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:36:57.462764 tst mo_mt_sms.py: using LAC 31034 19:36:57.587078 tst mo_mt_sms.py: using RAC 179 19:36:57.710233 tst mo_mt_sms.py: using CellId 31034 19:36:57.833069 tst mo_mt_sms.py: using BVCI 31035 19:36:57.948768 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:36:57.960019 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:36:57.971153 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:36:57.982632 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:36:57.993925 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:36:58.005405 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:36:58.124255 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:36:58.243104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:58.738173 run create_hlr_db(pid=19692): Launched 19:36:58.861099 bus /sierra_2: Setting Powered False 19:36:59.925071 run create_hlr_db(pid=19692): Terminated: ok {rc=0} 19:37:00.353280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19694): Launched 19:37:00.650673 run osmo-hlr_10.42.42.2(pid=19695): Launched 19:37:00.764251 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:01.408440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19697): Launched 19:37:01.824453 run osmo-stp_10.42.42.5(pid=19698): Launched 19:37:01.996853 run osmo-msc_10.42.42.6: Starting osmo-msc 19:37:02.721875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19700): Launched 19:37:03.018932 run osmo-msc_10.42.42.6(pid=19701): Launched 19:37:03.185370 run osmo-stp_10.42.42.5(pid=19698): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19698)] 19:37:03.310343 run osmo-stp_10.42.42.5(pid=19698): stdout: | (launched: 2022-12-12_19:37:01.748413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:03.435663 run osmo-stp_10.42.42.5(pid=19698): stderr: | 20221212193702071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193702071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193702072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193702072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193702072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193702073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193702073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:03.558952 run osmo-stp_10.42.42.5(pid=19698): stdout: | (launched: 2022-12-12_19:37:01.748413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:03.676626 run osmo-stp_10.42.42.5(pid=19698): stderr: | 20221212193702071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193702071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193702072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193702072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193702072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193702073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193702073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:03.817858 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19698): Process ended prematurely: osmo-stp_10.42.42.5(pid=19698) [trial-2381↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19698)] [trial-2381↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 19:37:03.825889 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 19:37:03.851622 run osmo-hlr_10.42.42.2(pid=19695): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19695)] 19:37:03.899163 run osmo-hlr_10.42.42.2(pid=19695): stdout: | (launched: 2022-12-12_19:37:00.596010) 19:37:03.948480 run osmo-hlr_10.42.42.2(pid=19695): stderr: | 20221212193700771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193700772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193700772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193700772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193700772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193700772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193700784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193700792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193700793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193700793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:04.017467 run osmo-msc_10.42.42.6(pid=19701): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19701)] 19:37:04.065090 run osmo-msc_10.42.42.6(pid=19701): stdout: | (launched: 2022-12-12_19:37:02.963848) 19:37:04.114038 run osmo-msc_10.42.42.6(pid=19701): stderr: | 20221212193703235 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193703235 DLGLOBAL DEBUG validating counter group 0x7f2aa3e8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193703235 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193703235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193703235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193703236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193703238 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193703239 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193703239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193703239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:37:04.163788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19694): Terminating (SIGTERM) 19:37:04.203228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19697): Terminating (SIGTERM) 19:37:04.242789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19700): Terminating (SIGTERM) 19:37:04.282727 --- ParallelTerminationStrategy: PID 19694 died... 19:37:04.301820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19694): Terminated: ok {rc=0} 19:37:04.346024 --- ParallelTerminationStrategy: PID 19697 died... 19:37:04.364385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19697): Terminated: ok {rc=0} 19:37:04.408130 --- ParallelTerminationStrategy: PID 19700 died... 19:37:04.426646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19700): Terminated: ok {rc=0} 19:37:04.512554 bus /sierra_3: Setting Powered False 19:37:05.612852 bus /sierra_3: Setting Powered False 19:37:06.728872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 19:37:07.960739 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:07.964782 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:37:07.999413 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 19:37:08.006208 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 19:37:08.042317 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:37:08.076336 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 19:37:08.083072 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 19:37:08.604184 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 19:37:08.610347 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 19:37:08.622262 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:37:08.674300 tst assert_extension.py: using LAC 31035 19:37:08.798251 tst assert_extension.py: using RAC 180 19:37:08.922428 tst assert_extension.py: using CellId 31035 19:37:09.046374 tst assert_extension.py: using BVCI 31036 19:37:09.163231 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 19:37:09.277451 tst assert_extension.py:10: start nitb and bts... 19:37:09.476367 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:37:10.085256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19706): Launched 19:37:10.384864 run osmo-nitb_10.42.42.2(pid=19707): Launched 19:37:10.549683 run osmo-nitb_10.42.42.2(pid=19707): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19707)] 19:37:10.683632 run osmo-nitb_10.42.42.2(pid=19707): stdout: | (launched: 2022-12-12_19:37:10.329536) 19:37:10.820363 run osmo-nitb_10.42.42.2(pid=19707): stderr: | (launched: 2022-12-12_19:37:10.373599) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:37:10.955974 run osmo-nitb_10.42.42.2(pid=19707): stdout: | (launched: 2022-12-12_19:37:10.329536) 19:37:11.086026 run osmo-nitb_10.42.42.2(pid=19707): stderr: | (launched: 2022-12-12_19:37:10.373599) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19707): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19707) [trial-2381↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19707)] 19:37:11.496668 tst osmo-nitb_10.42.42.2(pid=19707): stdout: | (launched: 2022-12-12_19:37:10.329536) 19:37:11.617731 tst osmo-nitb_10.42.42.2(pid=19707): stderr: | (launched: 2022-12-12_19:37:10.373599) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:37:11.759478 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19707): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19707) [trial-2381↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19707)] [trial-2381↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 19:37:11.767870 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:37:11.774407 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19706): Terminating (SIGTERM) 19:37:11.983285 --- ParallelTerminationStrategy: PID 19706 died... 19:37:12.004264 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19706): Terminated: ok {rc=0} 19:37:12.090993 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 19:37:13.271331 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:13.275167 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:37:13.308438 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:37:13.335118 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 19:37:13.370658 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:37:13.404341 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:37:13.430809 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 19:37:13.963247 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 19:37:13.968409 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:37:13.979356 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:37:14.028399 tst assert_extension.py: using LAC 31036 19:37:14.146571 tst assert_extension.py: using RAC 181 19:37:14.265504 tst assert_extension.py: using CellId 31036 19:37:14.386506 tst assert_extension.py: using BVCI 31037 19:37:14.495042 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:37:14.505873 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:37:14.516500 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:37:14.527052 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:37:14.537615 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:37:14.548212 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 19:37:14.665709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:15.161676 run create_hlr_db(pid=19711): Launched 19:37:15.286003 bus /sierra_2: Setting Powered False 19:37:16.347371 run create_hlr_db(pid=19711): Terminated: ok {rc=0} 19:37:16.806912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19713): Launched 19:37:17.130322 run osmo-hlr_10.42.42.2(pid=19714): Launched 19:37:17.308056 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:17.921779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19716): Launched 19:37:18.215161 run osmo-stp_10.42.42.5(pid=19717): Launched 19:37:18.327389 run osmo-msc_10.42.42.6: Starting osmo-msc 19:37:18.858904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19719): Launched 19:37:19.151454 run osmo-msc_10.42.42.6(pid=19720): Launched 19:37:19.315365 run osmo-stp_10.42.42.5(pid=19717): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19717)] 19:37:19.439789 run osmo-stp_10.42.42.5(pid=19717): stdout: | (launched: 2022-12-12_19:37:18.161238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:19.564805 run osmo-stp_10.42.42.5(pid=19717): stderr: | 20221212193718330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193718330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193718330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193718331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193718331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193718331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193718331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:19.687340 run osmo-stp_10.42.42.5(pid=19717): stdout: | (launched: 2022-12-12_19:37:18.161238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:19.804224 run osmo-stp_10.42.42.5(pid=19717): stderr: | 20221212193718330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193718330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193718330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193718331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193718331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193718331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193718331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:19.944162 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19717): Process ended prematurely: osmo-stp_10.42.42.5(pid=19717) [trial-2381↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19717)] [trial-2381↪ussd:trx-sysmocell5000↪assert_extension.py:17] 19:37:19.952667 tst assert_extension.py:17: Test FAILED (6.0 sec) 19:37:19.978587 run osmo-hlr_10.42.42.2(pid=19714): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19714)] 19:37:20.026795 run osmo-hlr_10.42.42.2(pid=19714): stdout: | (launched: 2022-12-12_19:37:17.072424) 19:37:20.076353 run osmo-hlr_10.42.42.2(pid=19714): stderr: | 20221212193717265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193717265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193717265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193717265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193717265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193717265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193717277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193717285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193717286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193717286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:20.145315 run osmo-msc_10.42.42.6(pid=19720): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19720)] 19:37:20.192816 run osmo-msc_10.42.42.6(pid=19720): stdout: | (launched: 2022-12-12_19:37:19.097532) 19:37:20.242098 run osmo-msc_10.42.42.6(pid=19720): stderr: | 20221212193719367 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193719367 DLGLOBAL DEBUG validating counter group 0x7f096c8efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193719367 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193719368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193719369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193719369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193719371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193719371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193719371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193719371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:37:20.291944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19713): Terminating (SIGTERM) 19:37:20.331629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19716): Terminating (SIGTERM) 19:37:20.371439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19719): Terminating (SIGTERM) 19:37:20.411271 --- ParallelTerminationStrategy: PID 19713 died... 19:37:20.430569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19713): Terminated: ok {rc=0} 19:37:20.474704 --- ParallelTerminationStrategy: PID 19716 died... 19:37:20.493333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19716): Terminated: ok {rc=0} 19:37:20.536901 --- ParallelTerminationStrategy: PID 19719 died... 19:37:20.555895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19719): Terminated: ok {rc=0} 19:37:20.641233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:37:21.853829 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:21.860030 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:37:21.894779 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:37:21.921126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:37:21.973664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:37:22.007186 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:37:22.033217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:37:22.585183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:37:22.635014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:22.646406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:37:22.716713 tst mo_mt_call.py: using LAC 31037 19:37:22.843282 tst mo_mt_call.py: using RAC 182 19:37:22.968674 tst mo_mt_call.py: using CellId 31037 19:37:23.093041 tst mo_mt_call.py: using BVCI 31038 19:37:23.208309 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:23.219975 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:23.231423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:23.243248 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:23.255100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:23.266890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:37:23.381723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:37:23.496167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:23.958871 run create_hlr_db(pid=19725): Launched 19:37:24.082210 bus /sierra_2: Setting Powered False 19:37:25.142816 run create_hlr_db(pid=19725): Terminated: ok {rc=0} 19:37:25.582932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19727): Launched 19:37:25.905229 run osmo-hlr_10.42.42.2(pid=19728): Launched 19:37:26.029146 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:26.583439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19730): Launched 19:37:26.903737 run osmo-stp_10.42.42.5(pid=19731): Launched 19:37:27.026740 run osmo-msc_10.42.42.6: Starting osmo-msc 19:37:27.605753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19733): Launched 19:37:27.926650 run osmo-msc_10.42.42.6(pid=19735): Launched 19:37:28.106675 run osmo-stp_10.42.42.5(pid=19731): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19731)] 19:37:28.242137 run osmo-stp_10.42.42.5(pid=19731): stdout: | (launched: 2022-12-12_19:37:26.845407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:28.382446 run osmo-stp_10.42.42.5(pid=19731): stderr: | 20221212193727035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193727035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193727035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193727036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193727036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193727036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193727036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:28.517662 run osmo-stp_10.42.42.5(pid=19731): stdout: | (launched: 2022-12-12_19:37:26.845407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:28.645133 run osmo-stp_10.42.42.5(pid=19731): stderr: | 20221212193727035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193727035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193727035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193727036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193727036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193727036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193727036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:28.798222 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19731): Process ended prematurely: osmo-stp_10.42.42.5(pid=19731) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19731)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:37:28.807836 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:37:28.836787 run osmo-hlr_10.42.42.2(pid=19728): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19728)] 19:37:28.887822 run osmo-hlr_10.42.42.2(pid=19728): stdout: | (launched: 2022-12-12_19:37:25.846746) 19:37:28.941065 run osmo-hlr_10.42.42.2(pid=19728): stderr: | 20221212193726042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193726042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193726043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193726043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193726043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193726043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193726055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193726064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193726064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193726064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:29.014471 run osmo-msc_10.42.42.6(pid=19735): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19735)] 19:37:29.065231 run osmo-msc_10.42.42.6(pid=19735): stdout: | (launched: 2022-12-12_19:37:27.868117) 19:37:29.117787 run osmo-msc_10.42.42.6(pid=19735): stderr: | 20221212193728188 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193728188 DLGLOBAL DEBUG validating counter group 0x7fb7573dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193728189 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193728189 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193728189 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193728189 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193728191 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193728191 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193728191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193728191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:37:29.170748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19727): Terminating (SIGTERM) 19:37:29.213061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19730): Terminating (SIGTERM) 19:37:29.255451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19733): Terminating (SIGTERM) 19:37:29.298017 --- ParallelTerminationStrategy: PID 19727 died... 19:37:29.318119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19727): Terminated: ok {rc=0} 19:37:29.365208 --- ParallelTerminationStrategy: PID 19730 died... 19:37:29.384687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19730): Terminated: ok {rc=0} 19:37:29.431529 --- ParallelTerminationStrategy: PID 19733 died... 19:37:29.451132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19733): Terminated: ok {rc=0} 19:37:29.538889 bus /sierra_3: Setting Powered False 19:37:30.638464 bus /sierra_3: Setting Powered False 19:37:31.760148 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:37:32.923997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:32.936446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:37:33.009244 tst mo_mt_call_osmux.py: using LAC 31038 19:37:33.136187 tst mo_mt_call_osmux.py: using RAC 183 19:37:33.261065 tst mo_mt_call_osmux.py: using CellId 31038 19:37:33.385785 tst mo_mt_call_osmux.py: using BVCI 31039 19:37:33.501870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:33.513608 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:33.525165 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:33.536905 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:33.548744 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:37:33.560513 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:37:33.676221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:37:33.797284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:34.296615 run create_hlr_db(pid=19742): Launched 19:37:34.419574 bus /sierra_2: Setting Powered False 19:37:35.484064 run create_hlr_db(pid=19742): Terminated: ok {rc=0} 19:37:35.914897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19744): Launched 19:37:36.215659 run osmo-hlr_10.42.42.2(pid=19745): Launched 19:37:36.330179 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:36.887737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19747): Launched 19:37:37.210898 run osmo-stp_10.42.42.5(pid=19748): Launched 19:37:37.333304 run osmo-msc_10.42.42.6: Starting osmo-msc 19:37:37.914577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19750): Launched 19:37:38.237542 run osmo-msc_10.42.42.6(pid=19751): Launched 19:37:38.417146 run osmo-stp_10.42.42.5(pid=19748): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19748)] 19:37:38.552800 run osmo-stp_10.42.42.5(pid=19748): stdout: | (launched: 2022-12-12_19:37:37.151705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:38.688890 run osmo-stp_10.42.42.5(pid=19748): stderr: | 20221212193737343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193737343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193737343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193737344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193737344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193737344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193737344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:38.824486 run osmo-stp_10.42.42.5(pid=19748): stdout: | (launched: 2022-12-12_19:37:37.151705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:38.952889 run osmo-stp_10.42.42.5(pid=19748): stderr: | 20221212193737343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193737343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193737343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193737344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193737344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193737344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193737344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:39.107301 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19748): Process ended prematurely: osmo-stp_10.42.42.5(pid=19748) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19748)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:37:39.116887 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:37:39.145710 run osmo-hlr_10.42.42.2(pid=19745): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19745)] 19:37:39.196277 run osmo-hlr_10.42.42.2(pid=19745): stdout: | (launched: 2022-12-12_19:37:36.160384) 19:37:39.248315 run osmo-hlr_10.42.42.2(pid=19745): stderr: | 20221212193736334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193736334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193736334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193736334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193736334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193736334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193736346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193736357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193736357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193736357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:39.320915 run osmo-msc_10.42.42.6(pid=19751): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19751)] 19:37:39.371213 run osmo-msc_10.42.42.6(pid=19751): stdout: | (launched: 2022-12-12_19:37:38.178852) 19:37:39.423115 run osmo-msc_10.42.42.6(pid=19751): stderr: | 20221212193738499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193738499 DLGLOBAL DEBUG validating counter group 0x7f0c16c77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193738499 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193738499 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193738500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193738500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193738502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193738502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193738502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193738502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:37:39.475538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19744): Terminating (SIGTERM) 19:37:39.517483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19747): Terminating (SIGTERM) 19:37:39.559515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19750): Terminating (SIGTERM) 19:37:39.601786 --- ParallelTerminationStrategy: PID 19744 died... 19:37:39.621798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19744): Terminated: ok {rc=0} 19:37:39.669092 --- ParallelTerminationStrategy: PID 19747 died... 19:37:39.688692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19747): Terminated: ok {rc=0} 19:37:39.735759 --- ParallelTerminationStrategy: PID 19750 died... 19:37:39.755835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19750): Terminated: ok {rc=0} 19:37:39.844091 bus /sierra_3: Setting Powered False 19:37:40.944215 bus /sierra_3: Setting Powered False 19:37:42.062197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:37:43.312856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:43.319474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:37:43.353186 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:37:43.379576 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:37:43.430684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:37:43.463947 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:37:43.490485 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:37:44.042794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:37:44.091139 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:44.102547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:37:44.176764 tst mo_mt_call.py: using LAC 31039 19:37:44.294644 tst mo_mt_call.py: using RAC 184 19:37:44.411026 tst mo_mt_call.py: using CellId 31039 19:37:44.528732 tst mo_mt_call.py: using BVCI 31040 19:37:44.637212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:44.648354 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:44.659455 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:44.670501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:44.681589 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:44.692595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:37:44.812791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:37:44.930391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:45.396103 run create_hlr_db(pid=19757): Launched 19:37:45.518790 bus /sierra_2: Setting Powered False 19:37:46.596921 run create_hlr_db(pid=19757): Terminated: ok {rc=0} 19:37:47.082189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19759): Launched 19:37:47.389736 run osmo-hlr_10.42.42.2(pid=19760): Launched 19:37:47.505137 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:48.026581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19762): Launched 19:37:48.326603 run osmo-stp_10.42.42.5(pid=19763): Launched 19:37:48.439899 run osmo-msc_10.42.42.6: Starting osmo-msc 19:37:48.987048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19765): Launched 19:37:49.288411 run osmo-msc_10.42.42.6(pid=19766): Launched 19:37:49.455712 run osmo-stp_10.42.42.5(pid=19763): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19763)] 19:37:49.582983 run osmo-stp_10.42.42.5(pid=19763): stdout: | (launched: 2022-12-12_19:37:48.271215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:49.710139 run osmo-stp_10.42.42.5(pid=19763): stderr: | 20221212193748438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193748438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193748439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193748439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193748440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193748440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193748440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:49.834758 run osmo-stp_10.42.42.5(pid=19763): stdout: | (launched: 2022-12-12_19:37:48.271215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:49.953936 run osmo-stp_10.42.42.5(pid=19763): stderr: | 20221212193748438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193748438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193748439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193748439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193748440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193748440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193748440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:50.096538 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19763): Process ended prematurely: osmo-stp_10.42.42.5(pid=19763) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19763)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:37:50.105741 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:37:50.132269 run osmo-hlr_10.42.42.2(pid=19760): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19760)] 19:37:50.180084 run osmo-hlr_10.42.42.2(pid=19760): stdout: | (launched: 2022-12-12_19:37:47.333419) 19:37:50.229580 run osmo-hlr_10.42.42.2(pid=19760): stderr: | 20221212193747509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193747509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193747509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193747509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193747509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193747509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193747522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193747531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193747531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193747531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:50.298517 run osmo-msc_10.42.42.6(pid=19766): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19766)] 19:37:50.346005 run osmo-msc_10.42.42.6(pid=19766): stdout: | (launched: 2022-12-12_19:37:49.232453) 19:37:50.396038 run osmo-msc_10.42.42.6(pid=19766): stderr: | 20221212193749504 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193749504 DLGLOBAL DEBUG validating counter group 0x7f40e273ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193749504 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193749504 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193749504 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193749505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193749506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193749507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193749507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193749507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:37:50.445827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19759): Terminating (SIGTERM) 19:37:50.485657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19762): Terminating (SIGTERM) 19:37:50.525414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19765): Terminating (SIGTERM) 19:37:50.565444 --- ParallelTerminationStrategy: PID 19759 died... 19:37:50.584469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19759): Terminated: ok {rc=0} 19:37:50.628296 --- ParallelTerminationStrategy: PID 19762 died... 19:37:50.647086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19762): Terminated: ok {rc=0} 19:37:50.690721 --- ParallelTerminationStrategy: PID 19765 died... 19:37:50.709357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19765): Terminated: ok {rc=0} 19:37:50.795283 bus /sierra_3: Setting Powered False 19:37:51.894858 bus /sierra_3: Setting Powered False 19:37:53.008173 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:37:54.149478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:54.161638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:37:54.231901 tst mo_mt_call_osmux.py: using LAC 31040 19:37:54.348648 tst mo_mt_call_osmux.py: using RAC 185 19:37:54.465964 tst mo_mt_call_osmux.py: using CellId 31040 19:37:54.583264 tst mo_mt_call_osmux.py: using BVCI 31041 19:37:54.702600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:54.714670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:54.726645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:54.739012 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:54.751454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:37:54.763874 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:37:54.884415 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:37:55.005320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:55.502479 run create_hlr_db(pid=19768): Launched 19:37:55.626492 bus /sierra_2: Setting Powered False 19:37:56.689956 run create_hlr_db(pid=19768): Terminated: ok {rc=0} 19:37:57.140290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19770): Launched 19:37:57.461269 run osmo-hlr_10.42.42.2(pid=19771): Launched 19:37:57.585635 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:58.136721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19773): Launched 19:37:58.458663 run osmo-stp_10.42.42.5(pid=19776): Launched 19:37:58.581810 run osmo-msc_10.42.42.6: Starting osmo-msc 19:37:59.166742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19778): Launched 19:37:59.489273 run osmo-msc_10.42.42.6(pid=19779): Launched 19:37:59.669134 run osmo-stp_10.42.42.5(pid=19776): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19776)] 19:37:59.805088 run osmo-stp_10.42.42.5(pid=19776): stdout: | (launched: 2022-12-12_19:37:58.399551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:59.942545 run osmo-stp_10.42.42.5(pid=19776): stderr: | 20221212193758588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193758589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193758589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193758589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193758590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193758590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193758590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:00.079219 run osmo-stp_10.42.42.5(pid=19776): stdout: | (launched: 2022-12-12_19:37:58.399551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:00.207954 run osmo-stp_10.42.42.5(pid=19776): stderr: | 20221212193758588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193758589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193758589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193758589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193758590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193758590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193758590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:00.361994 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19776): Process ended prematurely: osmo-stp_10.42.42.5(pid=19776) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19776)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:38:00.371864 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:38:00.399945 run osmo-hlr_10.42.42.2(pid=19771): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19771)] 19:38:00.450310 run osmo-hlr_10.42.42.2(pid=19771): stdout: | (launched: 2022-12-12_19:37:57.402791) 19:38:00.502502 run osmo-hlr_10.42.42.2(pid=19771): stderr: | 20221212193757599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193757599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193757599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193757599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193757599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193757599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193757632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193757643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193757643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193757643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:00.575093 run osmo-msc_10.42.42.6(pid=19779): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19779)] 19:38:00.625722 run osmo-msc_10.42.42.6(pid=19779): stdout: | (launched: 2022-12-12_19:37:59.430250) 19:38:00.677859 run osmo-msc_10.42.42.6(pid=19779): stderr: | 20221212193759752 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193759752 DLGLOBAL DEBUG validating counter group 0x7f8cf74b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193759752 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193759752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193759752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193759753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193759754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193759755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193759755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193759755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:00.730292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19770): Terminating (SIGTERM) 19:38:00.772352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19773): Terminating (SIGTERM) 19:38:00.814743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19778): Terminating (SIGTERM) 19:38:00.870142 --- ParallelTerminationStrategy: PID 19770 died... 19:38:00.889765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19770): Terminated: ok {rc=0} 19:38:00.939146 --- ParallelTerminationStrategy: PID 19773 died... 19:38:00.958315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19773): Terminated: ok {rc=0} 19:38:01.004287 --- ParallelTerminationStrategy: PID 19778 died... 19:38:01.023635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19778): Terminated: ok {rc=0} 19:38:01.110607 bus /sierra_3: Setting Powered False 19:38:02.210147 bus /sierra_3: Setting Powered False 19:38:03.339046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:38:04.600382 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:04.609108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:38:04.644376 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:38:04.671529 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:38:04.723119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:38:04.757991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:38:04.785684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:38:05.337500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:38:05.386427 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:05.397733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:38:05.466556 tst mo_mt_call.py: using LAC 31041 19:38:05.583336 tst mo_mt_call.py: using RAC 186 19:38:05.699658 tst mo_mt_call.py: using CellId 31041 19:38:05.816707 tst mo_mt_call.py: using BVCI 31042 19:38:05.925255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:05.936515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:05.947542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:05.959129 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:05.970785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:05.982499 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:38:06.103721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:38:06.220904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:06.689103 run create_hlr_db(pid=19784): Launched 19:38:06.811751 bus /sierra_2: Setting Powered False 19:38:07.871653 run create_hlr_db(pid=19784): Terminated: ok {rc=0} 19:38:08.310158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Launched 19:38:08.633677 run osmo-hlr_10.42.42.2(pid=19787): Launched 19:38:08.755936 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:09.310084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Launched 19:38:09.631485 run osmo-stp_10.42.42.5(pid=19790): Launched 19:38:09.754270 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:10.338113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19792): Launched 19:38:10.659965 run osmo-msc_10.42.42.6(pid=19793): Launched 19:38:10.842869 run osmo-stp_10.42.42.5(pid=19790): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] 19:38:10.979641 run osmo-stp_10.42.42.5(pid=19790): stdout: | (launched: 2022-12-12_19:38:09.572151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:11.116720 run osmo-stp_10.42.42.5(pid=19790): stderr: | 20221212193809762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193809762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193809762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193809763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193809763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193809763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193809763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:11.245940 run osmo-stp_10.42.42.5(pid=19790): stdout: | (launched: 2022-12-12_19:38:09.572151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:11.365487 run osmo-stp_10.42.42.5(pid=19790): stderr: | 20221212193809762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193809762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193809762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193809763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193809763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193809763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193809763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:11.507951 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19790): Process ended prematurely: osmo-stp_10.42.42.5(pid=19790) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:38:11.516774 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:38:11.542892 run osmo-hlr_10.42.42.2(pid=19787): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19787)] 19:38:11.590400 run osmo-hlr_10.42.42.2(pid=19787): stdout: | (launched: 2022-12-12_19:38:08.574627) 19:38:11.640226 run osmo-hlr_10.42.42.2(pid=19787): stderr: | 20221212193808772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193808772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193808772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193808772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193808772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193808772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193808785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193808793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193808793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193808793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:11.709063 run osmo-msc_10.42.42.6(pid=19793): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19793)] 19:38:11.756223 run osmo-msc_10.42.42.6(pid=19793): stdout: | (launched: 2022-12-12_19:38:10.601223) 19:38:11.805165 run osmo-msc_10.42.42.6(pid=19793): stderr: | 20221212193810922 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193810922 DLGLOBAL DEBUG validating counter group 0x7fbf51932c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193810922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193810922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193810922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193810922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193810924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193810925 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193810925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193810925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:11.854186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Terminating (SIGTERM) 19:38:11.893288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Terminating (SIGTERM) 19:38:11.932558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19792): Terminating (SIGTERM) 19:38:11.972203 --- ParallelTerminationStrategy: PID 19786 died... 19:38:11.991168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Terminated: ok {rc=0} 19:38:12.035158 --- ParallelTerminationStrategy: PID 19789 died... 19:38:12.053726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Terminated: ok {rc=0} 19:38:12.097483 --- ParallelTerminationStrategy: PID 19792 died... 19:38:12.116241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19792): Terminated: ok {rc=0} 19:38:12.201460 bus /sierra_3: Setting Powered False 19:38:13.304313 bus /sierra_3: Setting Powered False 19:38:14.423728 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:38:15.575593 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:15.588293 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:38:15.661612 tst mo_mt_call_osmux.py: using LAC 31042 19:38:15.789169 tst mo_mt_call_osmux.py: using RAC 187 19:38:15.927830 tst mo_mt_call_osmux.py: using CellId 31042 19:38:16.074252 tst mo_mt_call_osmux.py: using BVCI 31043 19:38:16.194380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:16.207357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:16.220086 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:16.234722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:16.248734 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:38:16.261590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:38:16.383402 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:38:16.507123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:17.019494 run create_hlr_db(pid=19795): Launched 19:38:17.176348 bus /sierra_2: Setting Powered False 19:38:18.240435 run create_hlr_db(pid=19795): Terminated: ok {rc=0} 19:38:18.671437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Launched 19:38:18.971221 run osmo-hlr_10.42.42.2(pid=19798): Launched 19:38:19.084550 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:19.620880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Launched 19:38:19.920770 run osmo-stp_10.42.42.5(pid=19801): Launched 19:38:20.035512 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:20.580917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19803): Launched 19:38:20.882076 run osmo-msc_10.42.42.6(pid=19804): Launched 19:38:21.052019 run osmo-stp_10.42.42.5(pid=19801): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] 19:38:21.178629 run osmo-stp_10.42.42.5(pid=19801): stdout: | (launched: 2022-12-12_19:38:19.865557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:21.305567 run osmo-stp_10.42.42.5(pid=19801): stderr: | 20221212193820032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193820032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193820033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193820033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193820033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193820034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193820034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:21.431556 run osmo-stp_10.42.42.5(pid=19801): stdout: | (launched: 2022-12-12_19:38:19.865557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:21.550983 run osmo-stp_10.42.42.5(pid=19801): stderr: | 20221212193820032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193820032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193820033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193820033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193820033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193820034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193820034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:21.694073 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19801): Process ended prematurely: osmo-stp_10.42.42.5(pid=19801) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:38:21.702806 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:38:21.729138 run osmo-hlr_10.42.42.2(pid=19798): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19798)] 19:38:21.777146 run osmo-hlr_10.42.42.2(pid=19798): stdout: | (launched: 2022-12-12_19:38:18.916058) 19:38:21.826751 run osmo-hlr_10.42.42.2(pid=19798): stderr: | 20221212193819090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193819090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193819090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193819090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193819090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193819090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193819103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193819112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193819112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193819112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:21.897217 run osmo-msc_10.42.42.6(pid=19804): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19804)] 19:38:21.944719 run osmo-msc_10.42.42.6(pid=19804): stdout: | (launched: 2022-12-12_19:38:20.826450) 19:38:21.994225 run osmo-msc_10.42.42.6(pid=19804): stderr: | 20221212193821096 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193821096 DLGLOBAL DEBUG validating counter group 0x7f830f1aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193821096 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193821096 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193821096 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193821097 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193821098 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193821099 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193821099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193821099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:22.044191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Terminating (SIGTERM) 19:38:22.083760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Terminating (SIGTERM) 19:38:22.123268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19803): Terminating (SIGTERM) 19:38:22.162956 --- ParallelTerminationStrategy: PID 19797 died... 19:38:22.182044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19797): Terminated: ok {rc=0} 19:38:22.226115 --- ParallelTerminationStrategy: PID 19800 died... 19:38:22.244578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19800): Terminated: ok {rc=0} 19:38:22.288867 --- ParallelTerminationStrategy: PID 19803 died... 19:38:22.307818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19803): Terminated: ok {rc=0} 19:38:22.393326 bus /sierra_3: Setting Powered False 19:38:23.492496 bus /sierra_3: Setting Powered False 19:38:24.608723 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:38:25.868050 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:25.875268 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:38:25.911225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:38:25.939150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:38:25.994341 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:38:26.029559 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:38:26.056549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:38:26.612190 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:38:26.664455 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:26.676337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:38:26.747548 tst mo_mt_call.py: using LAC 31043 19:38:26.872903 tst mo_mt_call.py: using RAC 188 19:38:26.997922 tst mo_mt_call.py: using CellId 31043 19:38:27.116797 tst mo_mt_call.py: using BVCI 31044 19:38:27.236725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:27.248551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:27.260132 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:27.272011 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:27.284005 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:27.295967 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:38:27.411872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:38:27.527426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:27.992511 run create_hlr_db(pid=19809): Launched 19:38:28.117203 bus /sierra_2: Setting Powered False 19:38:29.177715 run create_hlr_db(pid=19809): Terminated: ok {rc=0} 19:38:29.617171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19811): Launched 19:38:29.937385 run osmo-hlr_10.42.42.2(pid=19812): Launched 19:38:30.062436 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:30.619124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19814): Launched 19:38:30.973711 run osmo-stp_10.42.42.5(pid=19815): Launched 19:38:31.122165 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:31.790438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19817): Launched 19:38:32.111452 run osmo-msc_10.42.42.6(pid=19818): Launched 19:38:32.462023 run osmo-stp_10.42.42.5(pid=19815): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19815)] 19:38:32.602709 run osmo-stp_10.42.42.5(pid=19815): stdout: | (launched: 2022-12-12_19:38:30.895765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:32.735238 run osmo-stp_10.42.42.5(pid=19815): stderr: | 20221212193831240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193831240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193831240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193831241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193831242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193831242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193831242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:32.869046 run osmo-stp_10.42.42.5(pid=19815): stdout: | (launched: 2022-12-12_19:38:30.895765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:32.997047 run osmo-stp_10.42.42.5(pid=19815): stderr: | 20221212193831240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193831240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193831240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193831241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193831242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193831242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193831242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:33.150239 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19815): Process ended prematurely: osmo-stp_10.42.42.5(pid=19815) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19815)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:38:33.159772 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:38:33.188002 run osmo-hlr_10.42.42.2(pid=19812): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19812)] 19:38:33.238405 run osmo-hlr_10.42.42.2(pid=19812): stdout: | (launched: 2022-12-12_19:38:29.878781) 19:38:33.290499 run osmo-hlr_10.42.42.2(pid=19812): stderr: | 20221212193830074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193830074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193830074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193830074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193830074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193830074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193830087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193830095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193830095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193830095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:33.363050 run osmo-msc_10.42.42.6(pid=19818): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19818)] 19:38:33.413205 run osmo-msc_10.42.42.6(pid=19818): stdout: | (launched: 2022-12-12_19:38:32.046194) 19:38:33.465465 run osmo-msc_10.42.42.6(pid=19818): stderr: | 20221212193832542 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193832542 DLGLOBAL DEBUG validating counter group 0x7f2173be4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193832542 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193832542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193832542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193832542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193832544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193832545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193832545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193832545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:33.517763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19811): Terminating (SIGTERM) 19:38:33.559664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19814): Terminating (SIGTERM) 19:38:33.601558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19817): Terminating (SIGTERM) 19:38:33.643637 --- ParallelTerminationStrategy: PID 19811 died... 19:38:33.663636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19811): Terminated: ok {rc=0} 19:38:33.710477 --- ParallelTerminationStrategy: PID 19814 died... 19:38:33.729887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19814): Terminated: ok {rc=0} 19:38:33.776572 --- ParallelTerminationStrategy: PID 19817 died... 19:38:33.796068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19817): Terminated: ok {rc=0} 19:38:33.883786 bus /sierra_3: Setting Powered False 19:38:34.982053 bus /sierra_3: Setting Powered False 19:38:36.098543 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:38:37.247771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:37.260336 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:38:37.335894 tst mo_mt_call_osmux.py: using LAC 31044 19:38:37.460447 tst mo_mt_call_osmux.py: using RAC 189 19:38:37.585133 tst mo_mt_call_osmux.py: using CellId 31044 19:38:37.709048 tst mo_mt_call_osmux.py: using BVCI 31045 19:38:37.825652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:37.837468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:37.849562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:37.861520 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:37.873544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:38:37.885488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:38:38.003308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:38:38.122252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:38.621800 run create_hlr_db(pid=19820): Launched 19:38:38.746029 bus /sierra_2: Setting Powered False 19:38:39.810650 run create_hlr_db(pid=19820): Terminated: ok {rc=0} 19:38:40.261004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19822): Launched 19:38:40.582960 run osmo-hlr_10.42.42.2(pid=19823): Launched 19:38:40.708020 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:41.263708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19825): Launched 19:38:41.586480 run osmo-stp_10.42.42.5(pid=19826): Launched 19:38:41.711210 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:42.295606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19828): Launched 19:38:42.619806 run osmo-msc_10.42.42.6(pid=19829): Launched 19:38:42.799272 run osmo-stp_10.42.42.5(pid=19826): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19826)] 19:38:42.935230 run osmo-stp_10.42.42.5(pid=19826): stdout: | (launched: 2022-12-12_19:38:41.527842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:43.071985 run osmo-stp_10.42.42.5(pid=19826): stderr: | 20221212193841716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193841716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193841716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193841717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193841717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193841717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193841717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:43.207424 run osmo-stp_10.42.42.5(pid=19826): stdout: | (launched: 2022-12-12_19:38:41.527842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:43.335984 run osmo-stp_10.42.42.5(pid=19826): stderr: | 20221212193841716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193841716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193841716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193841717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193841717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193841717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193841717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:43.489711 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19826): Process ended prematurely: osmo-stp_10.42.42.5(pid=19826) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19826)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:38:43.499580 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:38:43.527986 run osmo-hlr_10.42.42.2(pid=19823): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19823)] 19:38:43.578972 run osmo-hlr_10.42.42.2(pid=19823): stdout: | (launched: 2022-12-12_19:38:40.524145) 19:38:43.631348 run osmo-hlr_10.42.42.2(pid=19823): stderr: | 20221212193840718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193840718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193840718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193840719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193840719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193840719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193840732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193840740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193840740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193840740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:43.704056 run osmo-msc_10.42.42.6(pid=19829): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19829)] 19:38:43.754779 run osmo-msc_10.42.42.6(pid=19829): stdout: | (launched: 2022-12-12_19:38:42.560694) 19:38:43.807704 run osmo-msc_10.42.42.6(pid=19829): stderr: | 20221212193842882 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193842882 DLGLOBAL DEBUG validating counter group 0x7fd35c200c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193842882 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193842882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193842882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193842883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193842884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193842885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193842885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193842885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:43.860520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19822): Terminating (SIGTERM) 19:38:43.902428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19825): Terminating (SIGTERM) 19:38:43.944469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19828): Terminating (SIGTERM) 19:38:43.987232 --- ParallelTerminationStrategy: PID 19822 died... 19:38:44.007412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19822): Terminated: ok {rc=0} 19:38:44.054330 --- ParallelTerminationStrategy: PID 19825 died... 19:38:44.074204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19825): Terminated: ok {rc=0} 19:38:44.121152 --- ParallelTerminationStrategy: PID 19828 died... 19:38:44.141117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19828): Terminated: ok {rc=0} 19:38:44.230347 bus /sierra_3: Setting Powered False 19:38:45.330445 bus /sierra_3: Setting Powered False 19:38:46.464826 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:38:47.787286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:47.794945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:38:47.840175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:38:47.875790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:38:47.944486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:38:48.000607 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:38:48.034556 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:38:48.571381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:38:48.627818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:38:48.645937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:38:48.721830 tst mo_mt_call.py: using LAC 31045 19:38:48.850978 tst mo_mt_call.py: using RAC 190 19:38:48.981445 tst mo_mt_call.py: using CellId 31045 19:38:49.110999 tst mo_mt_call.py: using BVCI 31046 19:38:49.233834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:38:49.246800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:38:49.259652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:38:49.274388 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:38:49.288428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:38:49.301151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:38:49.428189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:38:49.553207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:50.067062 run create_hlr_db(pid=20103): Launched 19:38:50.233209 bus /sierra_2: Setting Powered False 19:38:51.295006 run create_hlr_db(pid=20103): Terminated: ok {rc=0} 19:38:51.740144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20107): Launched 19:38:52.065880 run osmo-hlr_10.42.42.2(pid=20108): Launched 19:38:52.303080 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:53.009476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20110): Launched 19:38:53.351219 run osmo-stp_10.42.42.5(pid=20111): Launched 19:38:53.596530 run osmo-msc_10.42.42.6: Starting osmo-msc 19:38:54.272485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20113): Launched 19:38:54.616346 run osmo-msc_10.42.42.6(pid=20114): Launched 19:38:54.985701 run osmo-stp_10.42.42.5(pid=20111): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20111)] 19:38:55.269797 run osmo-stp_10.42.42.5(pid=20111): stdout: | (launched: 2022-12-12_19:38:53.291247) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:55.436542 run osmo-stp_10.42.42.5(pid=20111): stderr: | 20221212193853580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193853580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193853580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193853589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193853589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193853590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193853590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:55.577201 run osmo-stp_10.42.42.5(pid=20111): stdout: | (launched: 2022-12-12_19:38:53.291247) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:55.711398 run osmo-stp_10.42.42.5(pid=20111): stderr: | 20221212193853580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193853580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193853580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193853589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193853589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193853590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193853590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:55.871783 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20111): Process ended prematurely: osmo-stp_10.42.42.5(pid=20111) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20111)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:38:55.882564 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 19:38:55.914418 run osmo-hlr_10.42.42.2(pid=20108): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20108)] 19:38:55.968228 run osmo-hlr_10.42.42.2(pid=20108): stdout: | (launched: 2022-12-12_19:38:52.008303) 19:38:56.024183 run osmo-hlr_10.42.42.2(pid=20108): stderr: | 20221212193852345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193852345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193852345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193852345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193852346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193852346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193852359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193852372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193852372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193852372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:56.101230 run osmo-msc_10.42.42.6(pid=20114): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20114)] 19:38:56.154885 run osmo-msc_10.42.42.6(pid=20114): stdout: | (launched: 2022-12-12_19:38:54.555916) 19:38:56.210236 run osmo-msc_10.42.42.6(pid=20114): stderr: | 20221212193855061 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193855062 DLGLOBAL DEBUG validating counter group 0x7fb73f974c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193855062 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193855062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193855062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193855062 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193855064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193855064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193855065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193855065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:38:56.266226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20107): Terminating (SIGTERM) 19:38:56.311849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20110): Terminating (SIGTERM) 19:38:56.359436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20113): Terminating (SIGTERM) 19:38:56.406962 --- ParallelTerminationStrategy: PID 20107 died... 19:38:56.428450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20107): Terminated: ok {rc=0} 19:38:56.480661 --- ParallelTerminationStrategy: PID 20110 died... 19:38:56.501888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20110): Terminated: ok {rc=0} 19:38:56.552601 --- ParallelTerminationStrategy: PID 20113 died... 19:38:56.573866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20113): Terminated: ok {rc=0} 19:38:56.668480 bus /sierra_3: Setting Powered False 19:38:57.774441 bus /sierra_3: Setting Powered False 19:38:58.898480 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:39:00.060465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:00.074599 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:39:00.151717 tst mo_mt_call_osmux.py: using LAC 31046 19:39:00.284539 tst mo_mt_call_osmux.py: using RAC 191 19:39:00.417521 tst mo_mt_call_osmux.py: using CellId 31046 19:39:00.552503 tst mo_mt_call_osmux.py: using BVCI 31047 19:39:00.678088 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:00.691276 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:00.705787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:00.719551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:00.734835 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:39:00.747591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:39:00.895322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:39:01.058115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:01.586570 run create_hlr_db(pid=20116): Launched 19:39:01.753359 bus /sierra_2: Setting Powered False 19:39:02.831756 run create_hlr_db(pid=20116): Terminated: ok {rc=0} 19:39:03.288547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20118): Launched 19:39:03.610234 run osmo-hlr_10.42.42.2(pid=20119): Launched 19:39:03.863961 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:04.544214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20121): Launched 19:39:04.894946 run osmo-stp_10.42.42.5(pid=20122): Launched 19:39:05.151496 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:05.845460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20124): Launched 19:39:06.196414 run osmo-msc_10.42.42.6(pid=20125): Launched 19:39:06.571158 run osmo-stp_10.42.42.5(pid=20122): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20122)] 19:39:06.864543 run osmo-stp_10.42.42.5(pid=20122): stdout: | (launched: 2022-12-12_19:39:04.834194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:07.034290 run osmo-stp_10.42.42.5(pid=20122): stderr: | 20221212193905133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193905134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193905134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193905134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193905135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193905135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193905135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:07.177793 run osmo-stp_10.42.42.5(pid=20122): stdout: | (launched: 2022-12-12_19:39:04.834194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:07.315860 run osmo-stp_10.42.42.5(pid=20122): stderr: | 20221212193905133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193905134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193905134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193905134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193905135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193905135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193905135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:07.480153 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20122): Process ended prematurely: osmo-stp_10.42.42.5(pid=20122) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20122)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:39:07.492604 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 19:39:07.526225 run osmo-hlr_10.42.42.2(pid=20119): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20119)] 19:39:07.581344 run osmo-hlr_10.42.42.2(pid=20119): stdout: | (launched: 2022-12-12_19:39:03.552609) 19:39:07.637599 run osmo-hlr_10.42.42.2(pid=20119): stderr: | 20221212193903857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193903857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193903857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193903857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193903857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193903858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193903871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193903887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193903888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193903888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:07.715540 run osmo-msc_10.42.42.6(pid=20125): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20125)] 19:39:07.770954 run osmo-msc_10.42.42.6(pid=20125): stdout: | (launched: 2022-12-12_19:39:06.134829) 19:39:07.828703 run osmo-msc_10.42.42.6(pid=20125): stderr: | 20221212193906640 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193906640 DLGLOBAL DEBUG validating counter group 0x7fa2d05f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193906640 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193906640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193906640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193906645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193906647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193906647 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193906647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193906647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:07.885452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20118): Terminating (SIGTERM) 19:39:07.932336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20121): Terminating (SIGTERM) 19:39:07.980159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20124): Terminating (SIGTERM) 19:39:08.029923 --- ParallelTerminationStrategy: PID 20118 died... 19:39:08.051829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20118): Terminated: ok {rc=0} 19:39:08.105588 --- ParallelTerminationStrategy: PID 20121 died... 19:39:08.127848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20121): Terminated: ok {rc=0} 19:39:08.179434 --- ParallelTerminationStrategy: PID 20124 died... 19:39:08.201731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20124): Terminated: ok {rc=0} 19:39:08.297935 bus /sierra_3: Setting Powered False 19:39:09.400714 bus /sierra_3: Setting Powered False 19:39:10.518134 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:39:11.779552 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:11.786974 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:39:11.823057 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:39:11.850531 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:39:11.905306 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:39:11.941135 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:39:11.968925 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:39:12.520615 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:39:12.573941 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:12.586019 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:39:12.659427 tst mo_mt_call.py: using LAC 31047 19:39:12.781704 tst mo_mt_call.py: using RAC 192 19:39:12.901415 tst mo_mt_call.py: using CellId 31047 19:39:13.020506 tst mo_mt_call.py: using BVCI 31048 19:39:13.132132 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:13.143524 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:13.154684 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:13.165840 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:13.177033 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:13.188303 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:39:13.306571 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:39:13.423528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:13.897035 run create_hlr_db(pid=20131): Launched 19:39:14.022042 bus /sierra_2: Setting Powered False 19:39:15.082335 run create_hlr_db(pid=20131): Terminated: ok {rc=0} 19:39:15.527360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20133): Launched 19:39:15.855527 run osmo-hlr_10.42.42.2(pid=20134): Launched 19:39:16.144080 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:16.816135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20136): Launched 19:39:17.161746 run osmo-stp_10.42.42.5(pid=20137): Launched 19:39:17.343857 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:17.903470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20139): Launched 19:39:18.209976 run osmo-msc_10.42.42.6(pid=20140): Launched 19:39:18.380108 run osmo-stp_10.42.42.5(pid=20137): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20137)] 19:39:18.508937 run osmo-stp_10.42.42.5(pid=20137): stdout: | (launched: 2022-12-12_19:39:17.097899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:18.637407 run osmo-stp_10.42.42.5(pid=20137): stderr: | 20221212193917314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193917314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193917314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193917315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193917315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193917315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193917315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:18.764019 run osmo-stp_10.42.42.5(pid=20137): stdout: | (launched: 2022-12-12_19:39:17.097899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:18.884582 run osmo-stp_10.42.42.5(pid=20137): stderr: | 20221212193917314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193917314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193917314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193917315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193917315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193917315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193917315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:19.029429 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20137): Process ended prematurely: osmo-stp_10.42.42.5(pid=20137) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20137)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:39:19.038678 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:39:19.065111 run osmo-hlr_10.42.42.2(pid=20134): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20134)] 19:39:19.113248 run osmo-hlr_10.42.42.2(pid=20134): stdout: | (launched: 2022-12-12_19:39:15.795485) 19:39:19.163128 run osmo-hlr_10.42.42.2(pid=20134): stderr: | 20221212193916082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193916082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193916082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193916082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193916082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193916082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193916093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193916106 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193916106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193916106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:19.233117 run osmo-msc_10.42.42.6(pid=20140): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20140)] 19:39:19.281162 run osmo-msc_10.42.42.6(pid=20140): stdout: | (launched: 2022-12-12_19:39:18.153685) 19:39:19.330894 run osmo-msc_10.42.42.6(pid=20140): stderr: | 20221212193918426 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193918426 DLGLOBAL DEBUG validating counter group 0x7f976b327c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193918427 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193918427 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193918427 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193918427 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193918429 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193918429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193918429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193918429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:19.380940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20133): Terminating (SIGTERM) 19:39:19.420780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20136): Terminating (SIGTERM) 19:39:19.460729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20139): Terminating (SIGTERM) 19:39:19.500761 --- ParallelTerminationStrategy: PID 20133 died... 19:39:19.520036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20133): Terminated: ok {rc=0} 19:39:19.564182 --- ParallelTerminationStrategy: PID 20136 died... 19:39:19.582810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20136): Terminated: ok {rc=0} 19:39:19.626766 --- ParallelTerminationStrategy: PID 20139 died... 19:39:19.645398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20139): Terminated: ok {rc=0} 19:39:19.731511 bus /sierra_3: Setting Powered False 19:39:20.831926 bus /sierra_3: Setting Powered False 19:39:21.947621 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:39:23.097776 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:23.110553 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:39:23.184240 tst mo_mt_call_osmux.py: using LAC 31048 19:39:23.313113 tst mo_mt_call_osmux.py: using RAC 193 19:39:23.440832 tst mo_mt_call_osmux.py: using CellId 31048 19:39:23.571122 tst mo_mt_call_osmux.py: using BVCI 31049 19:39:23.690553 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:23.702505 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:23.714309 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:23.726389 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:23.738428 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:39:23.750341 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:39:23.871779 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:39:23.988897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:24.462268 run create_hlr_db(pid=20142): Launched 19:39:24.586924 bus /sierra_2: Setting Powered False 19:39:25.648055 run create_hlr_db(pid=20142): Terminated: ok {rc=0} 19:39:26.095771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20144): Launched 19:39:26.422584 run osmo-hlr_10.42.42.2(pid=20145): Launched 19:39:26.549454 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:27.113499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20147): Launched 19:39:27.441434 run osmo-stp_10.42.42.5(pid=20148): Launched 19:39:27.569380 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:28.163642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20150): Launched 19:39:28.492274 run osmo-msc_10.42.42.6(pid=20151): Launched 19:39:28.677407 run osmo-stp_10.42.42.5(pid=20148): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20148)] 19:39:28.816201 run osmo-stp_10.42.42.5(pid=20148): stdout: | (launched: 2022-12-12_19:39:27.381488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:28.955804 run osmo-stp_10.42.42.5(pid=20148): stderr: | 20221212193927574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193927574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193927574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193927575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193927575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193927575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193927575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:29.093570 run osmo-stp_10.42.42.5(pid=20148): stdout: | (launched: 2022-12-12_19:39:27.381488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:29.223866 run osmo-stp_10.42.42.5(pid=20148): stderr: | 20221212193927574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193927574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193927574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193927575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193927575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193927575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193927575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:29.380459 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20148): Process ended prematurely: osmo-stp_10.42.42.5(pid=20148) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20148)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:39:29.390393 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:39:29.419228 run osmo-hlr_10.42.42.2(pid=20145): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20145)] 19:39:29.470581 run osmo-hlr_10.42.42.2(pid=20145): stdout: | (launched: 2022-12-12_19:39:26.362895) 19:39:29.523667 run osmo-hlr_10.42.42.2(pid=20145): stderr: | 20221212193926562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193926562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193926562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193926562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193926562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193926562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193926575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193926583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193926583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193926583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:29.597521 run osmo-msc_10.42.42.6(pid=20151): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20151)] 19:39:29.648693 run osmo-msc_10.42.42.6(pid=20151): stdout: | (launched: 2022-12-12_19:39:28.431948) 19:39:29.701578 run osmo-msc_10.42.42.6(pid=20151): stderr: | 20221212193928754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193928754 DLGLOBAL DEBUG validating counter group 0x7f168de4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193928754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193928754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193928755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193928755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193928756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193928757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193928757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193928757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:29.755053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20144): Terminating (SIGTERM) 19:39:29.797656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20147): Terminating (SIGTERM) 19:39:29.840050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20150): Terminating (SIGTERM) 19:39:29.882470 --- ParallelTerminationStrategy: PID 20144 died... 19:39:29.902800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20144): Terminated: ok {rc=0} 19:39:29.950495 --- ParallelTerminationStrategy: PID 20147 died... 19:39:29.970297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20147): Terminated: ok {rc=0} 19:39:30.018111 --- ParallelTerminationStrategy: PID 20150 died... 19:39:30.038091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20150): Terminated: ok {rc=0} 19:39:30.128171 bus /sierra_3: Setting Powered False 19:39:31.250436 bus /sierra_3: Setting Powered False 19:39:32.368867 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:39:33.625633 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:33.632126 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:39:33.667282 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:39:33.695456 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:39:33.749670 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:39:33.785234 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:39:33.813007 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:39:34.362618 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:39:34.415717 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:34.427943 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:39:34.501803 tst mo_mt_call.py: using LAC 31049 19:39:34.630749 tst mo_mt_call.py: using RAC 194 19:39:34.757384 tst mo_mt_call.py: using CellId 31049 19:39:34.884887 tst mo_mt_call.py: using BVCI 31050 19:39:34.995969 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:35.007348 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:35.018662 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:35.029716 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:35.040930 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:35.052100 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:39:35.170503 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:39:35.291505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:35.798388 run create_hlr_db(pid=20161): Launched 19:39:35.923114 bus /sierra_2: Setting Powered False 19:39:36.987575 run create_hlr_db(pid=20161): Terminated: ok {rc=0} 19:39:37.425329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20163): Launched 19:39:37.730520 run osmo-hlr_10.42.42.2(pid=20164): Launched 19:39:37.846829 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:38.373882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20166): Launched 19:39:38.677914 run osmo-stp_10.42.42.5(pid=20167): Launched 19:39:38.796149 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:39.347176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20169): Launched 19:39:39.651413 run osmo-msc_10.42.42.6(pid=20170): Launched 19:39:39.821591 run osmo-stp_10.42.42.5(pid=20167): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20167)] 19:39:39.952304 run osmo-stp_10.42.42.5(pid=20167): stdout: | (launched: 2022-12-12_19:39:38.621139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:40.081147 run osmo-stp_10.42.42.5(pid=20167): stderr: | 20221212193938791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193938791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193938792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193938792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193938793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193938793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193938793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:40.208522 run osmo-stp_10.42.42.5(pid=20167): stdout: | (launched: 2022-12-12_19:39:38.621139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:40.329916 run osmo-stp_10.42.42.5(pid=20167): stderr: | 20221212193938791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193938791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193938792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193938792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193938793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193938793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193938793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:40.475205 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20167): Process ended prematurely: osmo-stp_10.42.42.5(pid=20167) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20167)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:39:40.484162 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:39:40.510433 run osmo-hlr_10.42.42.2(pid=20164): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20164)] 19:39:40.558374 run osmo-hlr_10.42.42.2(pid=20164): stdout: | (launched: 2022-12-12_19:39:37.674272) 19:39:40.608091 run osmo-hlr_10.42.42.2(pid=20164): stderr: | 20221212193937851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193937851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193937851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193937851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193937851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193937851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193937863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193937874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193937874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193937874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:40.677204 run osmo-msc_10.42.42.6(pid=20170): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20170)] 19:39:40.724709 run osmo-msc_10.42.42.6(pid=20170): stdout: | (launched: 2022-12-12_19:39:39.595152) 19:39:40.774459 run osmo-msc_10.42.42.6(pid=20170): stderr: | 20221212193939867 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193939867 DLGLOBAL DEBUG validating counter group 0x7f337b9e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193939867 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193939867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193939867 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193939867 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193939869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193939870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193939870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193939870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:40.824273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20163): Terminating (SIGTERM) 19:39:40.863818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20166): Terminating (SIGTERM) 19:39:40.903439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20169): Terminating (SIGTERM) 19:39:40.943219 --- ParallelTerminationStrategy: PID 20163 died... 19:39:40.962351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20163): Terminated: ok {rc=0} 19:39:41.006447 --- ParallelTerminationStrategy: PID 20166 died... 19:39:41.024917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20166): Terminated: ok {rc=0} 19:39:41.069834 --- ParallelTerminationStrategy: PID 20169 died... 19:39:41.088481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20169): Terminated: ok {rc=0} 19:39:41.172708 bus /sierra_3: Setting Powered False 19:39:42.270461 bus /sierra_3: Setting Powered False 19:39:43.383638 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:39:44.533815 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:44.546215 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:39:44.620748 tst mo_mt_call_osmux.py: using LAC 31050 19:39:44.751002 tst mo_mt_call_osmux.py: using RAC 195 19:39:44.878376 tst mo_mt_call_osmux.py: using CellId 31050 19:39:45.006090 tst mo_mt_call_osmux.py: using BVCI 31051 19:39:45.123894 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:45.135615 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:45.147085 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:45.158813 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:45.170697 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:39:45.182457 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:39:45.303915 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:39:45.429972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:45.964263 run create_hlr_db(pid=20172): Launched 19:39:46.153319 bus /sierra_2: Setting Powered False 19:39:47.220225 run create_hlr_db(pid=20172): Terminated: ok {rc=0} 19:39:47.678347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20174): Launched 19:39:48.005942 run osmo-hlr_10.42.42.2(pid=20175): Launched 19:39:48.132752 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:48.695548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20177): Launched 19:39:49.023087 run osmo-stp_10.42.42.5(pid=20178): Launched 19:39:49.148925 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:49.739107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20180): Launched 19:39:50.066707 run osmo-msc_10.42.42.6(pid=20181): Launched 19:39:50.251148 run osmo-stp_10.42.42.5(pid=20178): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20178)] 19:39:50.390019 run osmo-stp_10.42.42.5(pid=20178): stdout: | (launched: 2022-12-12_19:39:48.963222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:50.528670 run osmo-stp_10.42.42.5(pid=20178): stderr: | 20221212193949155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193949155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193949155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193949155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193949156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193949156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193949156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:50.665377 run osmo-stp_10.42.42.5(pid=20178): stdout: | (launched: 2022-12-12_19:39:48.963222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:50.794888 run osmo-stp_10.42.42.5(pid=20178): stderr: | 20221212193949155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212193949155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212193949155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212193949155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212193949156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212193949156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212193949156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:50.950148 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20178): Process ended prematurely: osmo-stp_10.42.42.5(pid=20178) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20178)] [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:39:50.959789 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:39:50.988247 run osmo-hlr_10.42.42.2(pid=20175): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20175)] 19:39:51.039343 run osmo-hlr_10.42.42.2(pid=20175): stdout: | (launched: 2022-12-12_19:39:47.945836) 19:39:51.091984 run osmo-hlr_10.42.42.2(pid=20175): stderr: | 20221212193948144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193948144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193948144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193948144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193948144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193948145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193948157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193948165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193948166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193948166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:51.164926 run osmo-msc_10.42.42.6(pid=20181): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20181)] 19:39:51.215650 run osmo-msc_10.42.42.6(pid=20181): stdout: | (launched: 2022-12-12_19:39:50.006916) 19:39:51.268016 run osmo-msc_10.42.42.6(pid=20181): stderr: | 20221212193950329 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212193950329 DLGLOBAL DEBUG validating counter group 0x7f4408dcac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212193950329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212193950329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212193950329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212193950330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212193950331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212193950331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212193950332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212193950332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:51.320663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20174): Terminating (SIGTERM) 19:39:51.362779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20177): Terminating (SIGTERM) 19:39:51.405043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20180): Terminating (SIGTERM) 19:39:51.447408 --- ParallelTerminationStrategy: PID 20174 died... 19:39:51.467513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20174): Terminated: ok {rc=0} 19:39:51.515192 --- ParallelTerminationStrategy: PID 20177 died... 19:39:51.534756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20177): Terminated: ok {rc=0} 19:39:51.581802 --- ParallelTerminationStrategy: PID 20180 died... 19:39:51.601430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20180): Terminated: ok {rc=0} 19:39:51.689520 bus /sierra_3: Setting Powered False 19:39:52.790332 bus /sierra_3: Setting Powered False 19:39:53.907528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 19:39:55.162498 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:55.167341 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:39:55.202492 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:39:55.229884 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 19:39:55.316703 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:39:55.350792 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:39:55.377602 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 19:39:55.960821 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 19:39:55.966355 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:39:55.977267 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:39:56.027064 tst emergency_mo_mt_call.py: using LAC 31051 19:39:56.145933 tst emergency_mo_mt_call.py: using RAC 196 19:39:56.272242 tst emergency_mo_mt_call.py: using CellId 31051 19:39:56.397205 tst emergency_mo_mt_call.py: using BVCI 31052 19:39:56.512689 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:39:56.524270 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:39:56.535467 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:39:56.546934 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:39:56.558446 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:39:56.569929 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:39:56.691623 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:39:56.810201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:57.306708 run create_hlr_db(pid=20186): Launched 19:39:57.430348 bus /sierra_2: Setting Powered False 19:39:58.494049 run create_hlr_db(pid=20186): Terminated: ok {rc=0} 19:39:58.923016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20188): Launched 19:39:59.222194 run osmo-hlr_10.42.42.2(pid=20189): Launched 19:39:59.335091 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:59.863427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20191): Launched 19:40:00.162251 run osmo-stp_10.42.42.5(pid=20192): Launched 19:40:00.285430 tst emergency_mo_mt_call.py: using MSISDN 7936 19:40:00.437800 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:00.994602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20194): Launched 19:40:01.398217 run osmo-msc_10.42.42.6(pid=20198): Launched 19:40:01.614646 run osmo-stp_10.42.42.5(pid=20192): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20192)] 19:40:01.814089 run osmo-stp_10.42.42.5(pid=20192): stdout: | (launched: 2022-12-12_19:40:00.106673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:02.063991 run osmo-stp_10.42.42.5(pid=20192): stderr: | 20221212194000276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194000276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194000277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194000277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194000278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194000279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194000279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:02.279218 run osmo-stp_10.42.42.5(pid=20192): stdout: | (launched: 2022-12-12_19:40:00.106673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:02.412016 run osmo-stp_10.42.42.5(pid=20192): stderr: | 20221212194000276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194000276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194000277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194000277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194000278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194000279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194000279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:02.565514 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20192): Process ended prematurely: osmo-stp_10.42.42.5(pid=20192) [trial-2381↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20192)] [trial-2381↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 19:40:02.574772 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 19:40:02.602793 run osmo-hlr_10.42.42.2(pid=20189): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20189)] 19:40:02.654401 run osmo-hlr_10.42.42.2(pid=20189): stdout: | (launched: 2022-12-12_19:39:59.166574) 19:40:02.706978 run osmo-hlr_10.42.42.2(pid=20189): stderr: | 20221212193959344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212193959344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212193959344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212193959344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212193959344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212193959344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212193959356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212193959365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212193959366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212193959366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:02.779962 run osmo-msc_10.42.42.6(pid=20198): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20198)] 19:40:02.830665 run osmo-msc_10.42.42.6(pid=20198): stdout: | (launched: 2022-12-12_19:40:01.337270) 19:40:02.883020 run osmo-msc_10.42.42.6(pid=20198): stderr: | 20221212194001976 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194001976 DLGLOBAL DEBUG validating counter group 0x7fe634800c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194001976 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194001976 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194001976 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194001977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194001978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194001979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194001979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194001979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:02.935865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20188): Terminating (SIGTERM) 19:40:02.978429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20191): Terminating (SIGTERM) 19:40:03.021387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20194): Terminating (SIGTERM) 19:40:03.064265 --- ParallelTerminationStrategy: PID 20188 died... 19:40:03.084543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20188): Terminated: ok {rc=0} 19:40:03.132274 --- ParallelTerminationStrategy: PID 20191 died... 19:40:03.152211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20191): Terminated: ok {rc=0} 19:40:03.199614 --- ParallelTerminationStrategy: PID 20194 died... 19:40:03.219441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20194): Terminated: ok {rc=0} 19:40:03.309452 bus /sierra_3: Setting Powered False 19:40:04.407275 bus /sierra_3: Setting Powered False 19:40:05.523769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 19:40:06.610293 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:40:06.622668 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:40:06.677120 tst emergency_preemptive_call.py: using LAC 31052 19:40:06.801471 tst emergency_preemptive_call.py: using RAC 197 19:40:06.928845 tst emergency_preemptive_call.py: using CellId 31052 19:40:07.054078 tst emergency_preemptive_call.py: using BVCI 31053 19:40:07.172056 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:40:07.183493 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:40:07.194787 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:40:07.206327 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:40:07.217944 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:40:07.229509 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:07.350803 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:07.466954 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:07.585986 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:07.703834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:08.202886 run create_hlr_db(pid=20200): Launched 19:40:08.325057 bus /sierra_2: Setting Powered False 19:40:09.387690 run create_hlr_db(pid=20200): Terminated: ok {rc=0} 19:40:09.835298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20202): Launched 19:40:10.158464 run osmo-hlr_10.42.42.2(pid=20203): Launched 19:40:10.283158 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:10.839616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20205): Launched 19:40:11.162635 run osmo-stp_10.42.42.5(pid=20206): Launched 19:40:11.296460 tst emergency_preemptive_call.py: using MSISDN 7937 19:40:11.463037 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:12.039996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20208): Launched 19:40:12.363574 run osmo-msc_10.42.42.6(pid=20209): Launched 19:40:12.543880 run osmo-stp_10.42.42.5(pid=20206): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20206)] 19:40:12.679394 run osmo-stp_10.42.42.5(pid=20206): stdout: | (launched: 2022-12-12_19:40:11.103329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:12.815515 run osmo-stp_10.42.42.5(pid=20206): stderr: | 20221212194011295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194011295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194011295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194011296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194011296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194011296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194011297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:12.951132 run osmo-stp_10.42.42.5(pid=20206): stdout: | (launched: 2022-12-12_19:40:11.103329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:13.080702 run osmo-stp_10.42.42.5(pid=20206): stderr: | 20221212194011295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194011295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194011295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194011296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194011296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194011296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194011297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:13.234602 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20206): Process ended prematurely: osmo-stp_10.42.42.5(pid=20206) [trial-2381↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20206)] [trial-2381↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 19:40:13.243738 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 19:40:13.272106 run osmo-hlr_10.42.42.2(pid=20203): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20203)] 19:40:13.323281 run osmo-hlr_10.42.42.2(pid=20203): stdout: | (launched: 2022-12-12_19:40:10.099563) 19:40:13.376342 run osmo-hlr_10.42.42.2(pid=20203): stderr: | 20221212194010298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194010298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194010298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194010298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194010298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194010298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194010311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194010319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194010319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194010319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:13.450375 run osmo-msc_10.42.42.6(pid=20209): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20209)] 19:40:13.501959 run osmo-msc_10.42.42.6(pid=20209): stdout: | (launched: 2022-12-12_19:40:12.304564) 19:40:13.555200 run osmo-msc_10.42.42.6(pid=20209): stderr: | 20221212194012626 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194012626 DLGLOBAL DEBUG validating counter group 0x7fb569ab3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194012626 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194012626 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194012626 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194012626 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194012628 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194012629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194012629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194012629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:13.608367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20202): Terminating (SIGTERM) 19:40:13.650990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20205): Terminating (SIGTERM) 19:40:13.693708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20208): Terminating (SIGTERM) 19:40:13.736640 --- ParallelTerminationStrategy: PID 20202 died... 19:40:13.757068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20202): Terminated: ok {rc=0} 19:40:13.804603 --- ParallelTerminationStrategy: PID 20205 died... 19:40:13.824526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20205): Terminated: ok {rc=0} 19:40:13.871700 --- ParallelTerminationStrategy: PID 20208 died... 19:40:13.891481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20208): Terminated: ok {rc=0} 19:40:13.981401 bus /sierra_9: Setting Powered False 19:40:15.081085 bus /sierra_9: Setting Powered False 19:40:16.194939 bus /sierra_8: Setting Powered False 19:40:17.293223 bus /sierra_8: Setting Powered False 19:40:18.407435 bus /sierra_3: Setting Powered False 19:40:19.506333 bus /sierra_3: Setting Powered False 19:40:20.627164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 19:40:21.909401 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:40:21.913777 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:40:21.947221 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 19:40:21.985376 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 19:40:22.071852 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:40:22.105420 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 19:40:22.143251 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 19:40:22.734369 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 19:40:22.784307 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:22.795224 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:40:22.849159 tst cs_paging_gprs_active.py: using LAC 31053 19:40:22.967805 tst cs_paging_gprs_active.py: using RAC 198 19:40:23.090006 tst cs_paging_gprs_active.py: using CellId 31053 19:40:23.209285 tst cs_paging_gprs_active.py: using BVCI 31054 19:40:23.319519 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.330436 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.341129 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.351808 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.362281 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.372716 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.383498 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.394042 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:23.404737 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:23.524568 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:23.643594 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:40:23.848010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:24.154159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20214): Launched 19:40:24.422665 run iperf3-srv_10.42.42.10(pid=20215): Launched 19:40:24.537118 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:40:24.741558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:25.048704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20216): Launched 19:40:25.316336 run iperf3-srv_10.42.42.10(pid=20217): Launched 19:40:25.430839 tst cs_paging_gprs_active.py:38: start network... 19:40:25.634293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:26.107220 run create_hlr_db(pid=20218): Launched 19:40:26.232364 bus /sierra_2: Setting Powered False 19:40:27.293631 run create_hlr_db(pid=20218): Terminated: ok {rc=0} 19:40:27.742723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20220): Launched 19:40:28.072086 run osmo-hlr_10.42.42.2(pid=20221): Launched 19:40:28.199941 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:28.762009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20223): Launched 19:40:29.090556 run osmo-stp_10.42.42.5(pid=20224): Launched 19:40:29.216250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:40:29.781314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20226): Launched 19:40:29.908291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:40:30.186146 run patchelf(pid=20227): Launched 19:40:30.368487 run osmo-stp_10.42.42.5(pid=20224): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20224)] 19:40:30.507620 run osmo-stp_10.42.42.5(pid=20224): stdout: | (launched: 2022-12-12_19:40:29.030203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:30.648227 run osmo-stp_10.42.42.5(pid=20224): stderr: | 20221212194029223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194029223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194029224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194029224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194029224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194029225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194029225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:30.788687 run osmo-stp_10.42.42.5(pid=20224): stdout: | (launched: 2022-12-12_19:40:29.030203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:30.941811 run osmo-stp_10.42.42.5(pid=20224): stderr: | 20221212194029223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194029223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194029224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194029224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194029224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194029225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194029225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:31.106412 run patchelf(pid=20227): Terminating (SIGINT) 19:40:31.294745 run patchelf(pid=20227): Terminated: ok {rc=0} 19:40:31.431378 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20224): Process ended prematurely: osmo-stp_10.42.42.5(pid=20224) [trial-2381↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20224)] [trial-2381↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 19:40:31.442960 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:40:31.475381 run osmo-hlr_10.42.42.2(pid=20221): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20221)] 19:40:31.528797 run osmo-hlr_10.42.42.2(pid=20221): stdout: | (launched: 2022-12-12_19:40:28.011446) 19:40:31.584125 run osmo-hlr_10.42.42.2(pid=20221): stderr: | 20221212194028210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194028210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194028210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194028210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194028210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194028210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194028222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194028231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194028231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194028231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:31.639849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20214): Terminating (SIGTERM) 19:40:31.685588 run iperf3-srv_10.42.42.10(pid=20215): Terminating (SIGTERM) 19:40:31.732874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20216): Terminating (SIGTERM) 19:40:31.778603 run iperf3-srv_10.42.42.10(pid=20217): Terminating (SIGTERM) 19:40:31.826445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20220): Terminating (SIGTERM) 19:40:31.871621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20223): Terminating (SIGTERM) 19:40:31.917317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20226): Terminating (SIGTERM) 19:40:31.963773 --- ParallelTerminationStrategy: PID 20214 died... 19:40:31.984853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20214): Terminated: ok {rc=0} 19:40:32.035640 --- ParallelTerminationStrategy: PID 20215 died... 19:40:32.056437 run iperf3-srv_10.42.42.10(pid=20215): Terminated {rc=256} 19:40:32.106679 --- ParallelTerminationStrategy: PID 20216 died... 19:40:32.127489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20216): Terminated: ok {rc=0} 19:40:32.177255 --- ParallelTerminationStrategy: PID 20217 died... 19:40:32.197037 run iperf3-srv_10.42.42.10(pid=20217): Terminated {rc=256} 19:40:32.244561 --- ParallelTerminationStrategy: PID 20220 died... 19:40:32.264439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20220): Terminated: ok {rc=0} 19:40:32.311945 --- ParallelTerminationStrategy: PID 20223 died... 19:40:32.331941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20223): Terminated: ok {rc=0} 19:40:32.379327 --- ParallelTerminationStrategy: PID 20226 died... 19:40:32.399423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20226): Terminated: ok {rc=0} 19:40:32.489362 bus /gobi_0: Setting Powered False 19:40:33.589068 bus /gobi_0: Setting Powered False 19:40:34.707369 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 19:40:35.859400 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:35.871391 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:40:35.926324 tst iperf3.py: using LAC 31054 19:40:36.055138 tst iperf3.py: using RAC 199 19:40:36.182440 tst iperf3.py: using CellId 31054 19:40:36.310931 tst iperf3.py: using BVCI 31055 19:40:36.430082 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.441530 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.452578 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.464059 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.475069 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.486230 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.497557 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.509217 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:36.521159 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:36.638457 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:40:36.844288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:37.150064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20228): Launched 19:40:37.416491 run iperf3-srv_10.42.42.10(pid=20229): Launched 19:40:37.531391 tst iperf3.py:8: start network... 19:40:37.735493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:38.208867 run create_hlr_db(pid=20230): Launched 19:40:38.334568 bus /gobi_6: Setting Powered False 19:40:39.399504 run create_hlr_db(pid=20230): Terminated: ok {rc=0} 19:40:39.855362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Launched 19:40:40.185054 run osmo-hlr_10.42.42.2(pid=20233): Launched 19:40:40.311497 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:40.880233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Launched 19:40:41.211020 run osmo-stp_10.42.42.5(pid=20236): Launched 19:40:41.338091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:40:41.909690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Launched 19:40:42.035064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:40:42.295149 run patchelf(pid=20239): Launched 19:40:42.466693 run osmo-stp_10.42.42.5(pid=20236): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] 19:40:42.597233 run osmo-stp_10.42.42.5(pid=20236): stdout: | (launched: 2022-12-12_19:40:41.151053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:42.728814 run osmo-stp_10.42.42.5(pid=20236): stderr: | 20221212194041345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194041346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194041346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194041346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194041347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194041347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194041347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:42.860674 run osmo-stp_10.42.42.5(pid=20236): stdout: | (launched: 2022-12-12_19:40:41.151053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:42.986209 run osmo-stp_10.42.42.5(pid=20236): stderr: | 20221212194041345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194041346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194041346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194041346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194041347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194041347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194041347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:43.135332 run patchelf(pid=20239): Terminating (SIGINT) 19:40:43.307237 run patchelf(pid=20239): Terminated: ok {rc=0} 19:40:43.431601 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20236): Process ended prematurely: osmo-stp_10.42.42.5(pid=20236) [trial-2381↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] [trial-2381↪gprs:trx-sysmocell5000↪iperf3.py:8] 19:40:43.441247 tst iperf3.py:8: Test FAILED (7.6 sec) 19:40:43.468685 run osmo-hlr_10.42.42.2(pid=20233): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20233)] 19:40:43.516684 run osmo-hlr_10.42.42.2(pid=20233): stdout: | (launched: 2022-12-12_19:40:40.125294) 19:40:43.566955 run osmo-hlr_10.42.42.2(pid=20233): stderr: | 20221212194040324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194040324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194040324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194040324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194040324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194040324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194040337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194040345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194040346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194040346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:43.617469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20228): Terminating (SIGTERM) 19:40:43.657623 run iperf3-srv_10.42.42.10(pid=20229): Terminating (SIGTERM) 19:40:43.697598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Terminating (SIGTERM) 19:40:43.737853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Terminating (SIGTERM) 19:40:43.777877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Terminating (SIGTERM) 19:40:43.818572 --- ParallelTerminationStrategy: PID 20228 died... 19:40:43.837814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20228): Terminated: ok {rc=0} 19:40:43.882333 --- ParallelTerminationStrategy: PID 20229 died... 19:40:43.901069 run iperf3-srv_10.42.42.10(pid=20229): Terminated {rc=256} 19:40:43.945225 --- ParallelTerminationStrategy: PID 20232 died... 19:40:43.963886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Terminated: ok {rc=0} 19:40:44.008148 --- ParallelTerminationStrategy: PID 20235 died... 19:40:44.026887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Terminated: ok {rc=0} 19:40:44.071302 --- ParallelTerminationStrategy: PID 20238 died... 19:40:44.090123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Terminated: ok {rc=0} 19:40:44.176482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 19:40:45.322974 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.337851 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:40:45.385964 tst iperf3m4.py: using LAC 31055 19:40:45.504796 tst iperf3m4.py: using RAC 200 19:40:45.625075 tst iperf3m4.py: using CellId 31055 19:40:45.743793 tst iperf3m4.py: using BVCI 31056 19:40:45.864580 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.881820 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.893188 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.904479 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.915663 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.926817 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.938157 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.949369 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:40:45.960520 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:46.075406 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:46.194714 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:46.312244 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:40:46.432437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:40:46.697673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:47.069529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20240): Launched 19:40:47.382999 run iperf3-srv_10.42.42.10(pid=20241): Launched 19:40:47.507325 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:40:47.728903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:48.059987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20242): Launched 19:40:48.348607 run iperf3-srv_10.42.42.10(pid=20243): Launched 19:40:48.472107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:40:48.693194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:49.023159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20244): Launched 19:40:49.311480 run iperf3-srv_10.42.42.10(pid=20245): Launched 19:40:49.436328 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:40:49.657509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:40:49.986750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20246): Launched 19:40:50.272907 run iperf3-srv_10.42.42.10(pid=20247): Launched 19:40:50.395707 tst iperf3m4.py:8: start network... 19:40:50.616898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:51.126004 run create_hlr_db(pid=20248): Launched 19:40:51.252089 bus /gobi_6: Setting Powered False 19:40:52.317292 run create_hlr_db(pid=20248): Terminated: ok {rc=0} 19:40:52.774132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20250): Launched 19:40:53.103155 run osmo-hlr_10.42.42.2(pid=20251): Launched 19:40:53.230594 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:53.796921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20253): Launched 19:40:54.127868 run osmo-stp_10.42.42.5(pid=20254): Launched 19:40:54.255255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:40:54.823047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20256): Launched 19:40:54.950117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:40:55.228853 run patchelf(pid=20257): Launched 19:40:55.413484 run osmo-stp_10.42.42.5(pid=20254): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20254)] 19:40:55.553209 run osmo-stp_10.42.42.5(pid=20254): stdout: | (launched: 2022-12-12_19:40:54.067247) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:55.694777 run osmo-stp_10.42.42.5(pid=20254): stderr: | 20221212194054258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194054259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194054259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194054259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194054260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194054260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194054260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:55.836464 run osmo-stp_10.42.42.5(pid=20254): stdout: | (launched: 2022-12-12_19:40:54.067247) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:55.971631 run osmo-stp_10.42.42.5(pid=20254): stderr: | 20221212194054258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194054259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194054259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194054259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194054260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194054260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194054260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:56.132442 run patchelf(pid=20257): Terminating (SIGINT) 19:40:56.316354 run patchelf(pid=20257): Terminated: ok {rc=0} 19:40:56.449392 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20254): Process ended prematurely: osmo-stp_10.42.42.5(pid=20254) [trial-2381↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20254)] [trial-2381↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 19:40:56.459783 tst iperf3m4.py:8: Test FAILED (11.2 sec) 19:40:56.489439 run osmo-hlr_10.42.42.2(pid=20251): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20251)] 19:40:56.541520 run osmo-hlr_10.42.42.2(pid=20251): stdout: | (launched: 2022-12-12_19:40:53.042583) 19:40:56.594981 run osmo-hlr_10.42.42.2(pid=20251): stderr: | 20221212194053242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194053242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194053242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194053242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194053242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194053242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194053254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194053262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194053263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194053263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:56.649152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20240): Terminating (SIGTERM) 19:40:56.692419 run iperf3-srv_10.42.42.10(pid=20241): Terminating (SIGTERM) 19:40:56.735464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20242): Terminating (SIGTERM) 19:40:56.778947 run iperf3-srv_10.42.42.10(pid=20243): Terminating (SIGTERM) 19:40:56.821907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20244): Terminating (SIGTERM) 19:40:56.865054 run iperf3-srv_10.42.42.10(pid=20245): Terminating (SIGTERM) 19:40:56.908157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20246): Terminating (SIGTERM) 19:40:56.951356 run iperf3-srv_10.42.42.10(pid=20247): Terminating (SIGTERM) 19:40:56.994350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20250): Terminating (SIGTERM) 19:40:57.037650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20253): Terminating (SIGTERM) 19:40:57.081163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20256): Terminating (SIGTERM) 19:40:57.124638 --- ParallelTerminationStrategy: PID 20240 died... 19:40:57.145271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20240): Terminated: ok {rc=0} 19:40:57.193107 --- ParallelTerminationStrategy: PID 20241 died... 19:40:57.212882 run iperf3-srv_10.42.42.10(pid=20241): Terminated {rc=256} 19:40:57.260907 --- ParallelTerminationStrategy: PID 20242 died... 19:40:57.281028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20242): Terminated: ok {rc=0} 19:40:57.328514 --- ParallelTerminationStrategy: PID 20243 died... 19:40:57.348630 run iperf3-srv_10.42.42.10(pid=20243): Terminated {rc=256} 19:40:57.396240 --- ParallelTerminationStrategy: PID 20244 died... 19:40:57.416386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20244): Terminated: ok {rc=0} 19:40:57.463947 --- ParallelTerminationStrategy: PID 20245 died... 19:40:57.483938 run iperf3-srv_10.42.42.10(pid=20245): Terminated {rc=256} 19:40:57.531544 --- ParallelTerminationStrategy: PID 20246 died... 19:40:57.551710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20246): Terminated: ok {rc=0} 19:40:57.599229 --- ParallelTerminationStrategy: PID 20247 died... 19:40:57.619293 run iperf3-srv_10.42.42.10(pid=20247): Terminated {rc=256} 19:40:57.666998 --- ParallelTerminationStrategy: PID 20250 died... 19:40:57.687080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20250): Terminated: ok {rc=0} 19:40:57.734633 --- ParallelTerminationStrategy: PID 20253 died... 19:40:57.754608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20253): Terminated: ok {rc=0} 19:40:57.802575 --- ParallelTerminationStrategy: PID 20256 died... 19:40:57.822731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20256): Terminated: ok {rc=0} 19:40:57.913328 bus /gobi_4: Setting Powered False 19:40:59.014990 bus /gobi_4: Setting Powered False 19:41:00.135923 bus /gobi_1: Setting Powered False 19:41:01.244692 bus /gobi_1: Setting Powered False 19:41:02.374314 bus /gobi_0: Setting Powered False 19:41:03.475385 bus /gobi_0: Setting Powered False 19:41:04.593385 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 19:41:05.699619 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:05.711448 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:41:05.760264 tst ping.py: using LAC 31056 19:41:05.878048 tst ping.py: using RAC 201 19:41:05.995162 tst ping.py: using CellId 31056 19:41:06.114693 tst ping.py: using BVCI 31057 19:41:06.224755 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:06.235697 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:06.246532 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:06.257274 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:06.267922 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:06.278659 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:06.289545 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:06.300237 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:41:06.417899 tst ping.py:19: start network... 19:41:06.636528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:07.135454 run create_hlr_db(pid=20259): Launched 19:41:07.258554 bus /gobi_6: Setting Powered False 19:41:08.322519 run create_hlr_db(pid=20259): Terminated: ok {rc=0} 19:41:08.771738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20261): Launched 19:41:09.094677 run osmo-hlr_10.42.42.2(pid=20262): Launched 19:41:09.217398 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:09.777652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20264): Launched 19:41:10.100373 run osmo-stp_10.42.42.5(pid=20265): Launched 19:41:10.223692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:10.782263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20267): Launched 19:41:10.906114 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:11.180170 run patchelf(pid=20268): Launched 19:41:11.361280 run osmo-stp_10.42.42.5(pid=20265): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20265)] 19:41:11.498037 run osmo-stp_10.42.42.5(pid=20265): stdout: | (launched: 2022-12-12_19:41:10.040794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:11.636456 run osmo-stp_10.42.42.5(pid=20265): stderr: | 20221212194110232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194110233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194110233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194110233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194110234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194110234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194110234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:11.775019 run osmo-stp_10.42.42.5(pid=20265): stdout: | (launched: 2022-12-12_19:41:10.040794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:11.907589 run osmo-stp_10.42.42.5(pid=20265): stderr: | 20221212194110232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194110233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194110233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194110233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194110234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194110234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194110234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:12.065077 run patchelf(pid=20268): Terminating (SIGINT) 19:41:12.244942 run patchelf(pid=20268): Terminated: ok {rc=0} 19:41:12.374667 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20265): Process ended prematurely: osmo-stp_10.42.42.5(pid=20265) [trial-2381↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20265)] [trial-2381↪gprs:trx-sysmocell5000↪ping.py:22] 19:41:12.384340 tst ping.py:22: Test FAILED (6.7 sec) 19:41:12.413517 run osmo-hlr_10.42.42.2(pid=20262): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20262)] 19:41:12.465167 run osmo-hlr_10.42.42.2(pid=20262): stdout: | (launched: 2022-12-12_19:41:09.035189) 19:41:12.518628 run osmo-hlr_10.42.42.2(pid=20262): stderr: | 20221212194109233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194109233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194109233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194109233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194109233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194109233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194109245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194109253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194109254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194109254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:12.573074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20261): Terminating (SIGTERM) 19:41:12.616115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20264): Terminating (SIGTERM) 19:41:12.659337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20267): Terminating (SIGTERM) 19:41:12.703286 --- ParallelTerminationStrategy: PID 20261 died... 19:41:12.724040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20261): Terminated: ok {rc=0} 19:41:12.772641 --- ParallelTerminationStrategy: PID 20264 died... 19:41:12.793053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20264): Terminated: ok {rc=0} 19:41:12.841239 --- ParallelTerminationStrategy: PID 20267 died... 19:41:12.861417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20267): Terminated: ok {rc=0} 19:41:12.952524 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 19:41:14.042328 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.054030 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:41:14.104904 tst ping_idle_ping.py: using LAC 31057 19:41:14.228800 tst ping_idle_ping.py: using RAC 202 19:41:14.345566 tst ping_idle_ping.py: using CellId 31057 19:41:14.470760 tst ping_idle_ping.py: using BVCI 31058 19:41:14.588923 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.600528 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.611722 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.623478 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.634842 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.646362 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.658025 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:41:14.669531 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:41:14.785407 tst ping_idle_ping.py:24: start network... 19:41:14.988304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:15.457797 run create_hlr_db(pid=20269): Launched 19:41:15.583711 bus /gobi_6: Setting Powered False 19:41:16.650806 run create_hlr_db(pid=20269): Terminated: ok {rc=0} 19:41:17.121698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Launched 19:41:17.437427 run osmo-hlr_10.42.42.2(pid=20272): Launched 19:41:17.556148 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:18.081115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Launched 19:41:18.382647 run osmo-stp_10.42.42.5(pid=20275): Launched 19:41:18.499136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:19.021385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20277): Launched 19:41:19.135648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:19.389540 run patchelf(pid=20278): Launched 19:41:19.556625 run osmo-stp_10.42.42.5(pid=20275): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] 19:41:19.683752 run osmo-stp_10.42.42.5(pid=20275): stdout: | (launched: 2022-12-12_19:41:18.326750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:19.812632 run osmo-stp_10.42.42.5(pid=20275): stderr: | 20221212194118494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194118494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194118495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194118495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194118496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194118496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194118496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:19.941770 run osmo-stp_10.42.42.5(pid=20275): stdout: | (launched: 2022-12-12_19:41:18.326750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:20.064700 run osmo-stp_10.42.42.5(pid=20275): stderr: | 20221212194118494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194118494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194118495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194118495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194118496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194118496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194118496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:20.210638 run patchelf(pid=20278): Terminating (SIGINT) 19:41:20.378923 run patchelf(pid=20278): Terminated: ok {rc=0} 19:41:20.500074 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20275): Process ended prematurely: osmo-stp_10.42.42.5(pid=20275) [trial-2381↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] [trial-2381↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 19:41:20.509123 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:41:20.536052 run osmo-hlr_10.42.42.2(pid=20272): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20272)] 19:41:20.584225 run osmo-hlr_10.42.42.2(pid=20272): stdout: | (launched: 2022-12-12_19:41:17.381493) 19:41:20.634345 run osmo-hlr_10.42.42.2(pid=20272): stderr: | 20221212194117559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194117560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194117560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194117560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194117560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194117560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194117572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194117581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194117582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194117582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:20.685142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Terminating (SIGTERM) 19:41:20.725483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Terminating (SIGTERM) 19:41:20.766259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20277): Terminating (SIGTERM) 19:41:20.806697 --- ParallelTerminationStrategy: PID 20271 died... 19:41:20.825948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Terminated: ok {rc=0} 19:41:20.870089 --- ParallelTerminationStrategy: PID 20274 died... 19:41:20.888790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Terminated: ok {rc=0} 19:41:20.932711 --- ParallelTerminationStrategy: PID 20277 died... 19:41:20.951499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20277): Terminated: ok {rc=0} 19:41:21.038783 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 19:41:22.361112 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:41:22.367129 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:41:22.404063 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:41:22.444292 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:41:22.535739 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:41:22.570643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:41:22.608613 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:41:23.201946 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:41:23.258162 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.269842 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:41:23.323624 tst cs_paging_gprs_active.py: using LAC 31058 19:41:23.453384 tst cs_paging_gprs_active.py: using RAC 203 19:41:23.582721 tst cs_paging_gprs_active.py: using CellId 31058 19:41:23.710254 tst cs_paging_gprs_active.py: using BVCI 31059 19:41:23.830977 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.842669 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.854170 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.865826 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.877340 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.888807 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.900624 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.912135 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:23.923777 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:24.041434 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:24.158857 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:41:24.365383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:24.674312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20282): Launched 19:41:24.942808 run iperf3-srv_10.42.42.10(pid=20283): Launched 19:41:25.057428 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:41:25.262256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:25.570531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20284): Launched 19:41:25.838778 run iperf3-srv_10.42.42.10(pid=20285): Launched 19:41:25.953431 tst cs_paging_gprs_active.py:38: start network... 19:41:26.157787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:26.631876 run create_hlr_db(pid=20286): Launched 19:41:26.757644 bus /gobi_6: Setting Powered False 19:41:27.817783 run create_hlr_db(pid=20286): Terminated: ok {rc=0} 19:41:28.266037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Launched 19:41:28.594979 run osmo-hlr_10.42.42.2(pid=20289): Launched 19:41:28.722612 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:29.285159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Launched 19:41:29.613705 run osmo-stp_10.42.42.5(pid=20292): Launched 19:41:29.740523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:30.309565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20294): Launched 19:41:30.436270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:30.714528 run patchelf(pid=20295): Launched 19:41:30.920366 run osmo-stp_10.42.42.5(pid=20292): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] 19:41:31.055821 run osmo-stp_10.42.42.5(pid=20292): stdout: | (launched: 2022-12-12_19:41:29.553739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:31.192358 run osmo-stp_10.42.42.5(pid=20292): stderr: | 20221212194129747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194129747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194129747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194129748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194129748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194129748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194129748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:31.328666 run osmo-stp_10.42.42.5(pid=20292): stdout: | (launched: 2022-12-12_19:41:29.553739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:31.458920 run osmo-stp_10.42.42.5(pid=20292): stderr: | 20221212194129747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194129747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194129747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194129748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194129748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194129748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194129748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:31.613622 run patchelf(pid=20295): Terminating (SIGINT) 19:41:31.791743 run patchelf(pid=20295): Terminated: ok {rc=0} 19:41:31.921451 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20292): Process ended prematurely: osmo-stp_10.42.42.5(pid=20292) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:41:31.932982 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:41:31.961698 run osmo-hlr_10.42.42.2(pid=20289): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20289)] 19:41:32.011201 run osmo-hlr_10.42.42.2(pid=20289): stdout: | (launched: 2022-12-12_19:41:28.535146) 19:41:32.070159 run osmo-hlr_10.42.42.2(pid=20289): stderr: | 20221212194128733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194128733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194128733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194128733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194128733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194128733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194128745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194128754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194128754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194128754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:32.132294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20282): Terminating (SIGTERM) 19:41:32.177830 run iperf3-srv_10.42.42.10(pid=20283): Terminating (SIGTERM) 19:41:32.223719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20284): Terminating (SIGTERM) 19:41:32.266838 run iperf3-srv_10.42.42.10(pid=20285): Terminating (SIGTERM) 19:41:32.309608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Terminating (SIGTERM) 19:41:32.352409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Terminating (SIGTERM) 19:41:32.395137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20294): Terminating (SIGTERM) 19:41:32.438425 --- ParallelTerminationStrategy: PID 20282 died... 19:41:32.458480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20282): Terminated: ok {rc=0} 19:41:32.506169 --- ParallelTerminationStrategy: PID 20283 died... 19:41:32.525784 run iperf3-srv_10.42.42.10(pid=20283): Terminated {rc=256} 19:41:32.572706 --- ParallelTerminationStrategy: PID 20284 died... 19:41:32.592528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20284): Terminated: ok {rc=0} 19:41:32.639496 --- ParallelTerminationStrategy: PID 20285 died... 19:41:32.659153 run iperf3-srv_10.42.42.10(pid=20285): Terminated {rc=256} 19:41:32.705967 --- ParallelTerminationStrategy: PID 20288 died... 19:41:32.725645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Terminated: ok {rc=0} 19:41:32.772783 --- ParallelTerminationStrategy: PID 20291 died... 19:41:32.792472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Terminated: ok {rc=0} 19:41:32.839376 --- ParallelTerminationStrategy: PID 20294 died... 19:41:32.859136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20294): Terminated: ok {rc=0} 19:41:32.948130 bus /gobi_0: Setting Powered False 19:41:34.048397 bus /gobi_0: Setting Powered False 19:41:35.164555 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:41:36.315052 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.327261 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:41:36.382269 tst iperf3.py: using LAC 31059 19:41:36.516262 tst iperf3.py: using RAC 204 19:41:36.648532 tst iperf3.py: using CellId 31059 19:41:36.791001 tst iperf3.py: using BVCI 31060 19:41:36.911140 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.922874 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.934255 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.945962 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.957516 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.969149 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.980886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:36.992440 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:37.004258 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:37.119503 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:41:37.324624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:37.630965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20296): Launched 19:41:37.897485 run iperf3-srv_10.42.42.10(pid=20297): Launched 19:41:38.011802 tst iperf3.py:8: start network... 19:41:38.215267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:38.686128 run create_hlr_db(pid=20298): Launched 19:41:38.811335 bus /gobi_6: Setting Powered False 19:41:39.871794 run create_hlr_db(pid=20298): Terminated: ok {rc=0} 19:41:40.318854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20300): Launched 19:41:40.649549 run osmo-hlr_10.42.42.2(pid=20301): Launched 19:41:40.776706 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:41.343922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20303): Launched 19:41:41.671353 run osmo-stp_10.42.42.5(pid=20304): Launched 19:41:41.797762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:42.363381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20306): Launched 19:41:42.488485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:42.766341 run patchelf(pid=20307): Launched 19:41:42.950732 run osmo-stp_10.42.42.5(pid=20304): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20304)] 19:41:43.090928 run osmo-stp_10.42.42.5(pid=20304): stdout: | (launched: 2022-12-12_19:41:41.611511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:43.232287 run osmo-stp_10.42.42.5(pid=20304): stderr: | 20221212194141804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194141804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194141804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194141805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194141805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194141805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194141805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:43.373174 run osmo-stp_10.42.42.5(pid=20304): stdout: | (launched: 2022-12-12_19:41:41.611511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:43.507990 run osmo-stp_10.42.42.5(pid=20304): stderr: | 20221212194141804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194141804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194141804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194141805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194141805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194141805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194141805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:43.667768 run patchelf(pid=20307): Terminating (SIGINT) 19:41:43.851296 run patchelf(pid=20307): Terminated: ok {rc=0} 19:41:43.984006 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20304): Process ended prematurely: osmo-stp_10.42.42.5(pid=20304) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20304)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 19:41:43.994551 tst iperf3.py:8: Test FAILED (7.7 sec) 19:41:44.024047 run osmo-hlr_10.42.42.2(pid=20301): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20301)] 19:41:44.075863 run osmo-hlr_10.42.42.2(pid=20301): stdout: | (launched: 2022-12-12_19:41:40.589546) 19:41:44.129079 run osmo-hlr_10.42.42.2(pid=20301): stderr: | 20221212194140787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194140787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194140787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194140787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194140788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194140788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194140799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194140809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194140809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194140809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:44.182412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20296): Terminating (SIGTERM) 19:41:44.225104 run iperf3-srv_10.42.42.10(pid=20297): Terminating (SIGTERM) 19:41:44.267600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20300): Terminating (SIGTERM) 19:41:44.310028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20303): Terminating (SIGTERM) 19:41:44.352589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20306): Terminating (SIGTERM) 19:41:44.395692 --- ParallelTerminationStrategy: PID 20296 died... 19:41:44.415988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20296): Terminated: ok {rc=0} 19:41:44.463742 --- ParallelTerminationStrategy: PID 20297 died... 19:41:44.483401 run iperf3-srv_10.42.42.10(pid=20297): Terminated {rc=256} 19:41:44.530316 --- ParallelTerminationStrategy: PID 20300 died... 19:41:44.549977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20300): Terminated: ok {rc=0} 19:41:44.597080 --- ParallelTerminationStrategy: PID 20303 died... 19:41:44.616826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20303): Terminated: ok {rc=0} 19:41:44.664027 --- ParallelTerminationStrategy: PID 20306 died... 19:41:44.683935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20306): Terminated: ok {rc=0} 19:41:44.774227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:41:45.944398 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:45.957886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:41:46.019996 tst iperf3m4.py: using LAC 31060 19:41:46.149100 tst iperf3m4.py: using RAC 205 19:41:46.308675 tst iperf3m4.py: using CellId 31060 19:41:46.442311 tst iperf3m4.py: using BVCI 31061 19:41:46.584100 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.595920 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.607827 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.619883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.631723 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.643741 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.655923 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.672387 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:41:46.684323 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:46.820728 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:46.982383 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:47.101939 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:41:47.220051 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:41:47.439429 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:47.746814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Launched 19:41:48.014225 run iperf3-srv_10.42.42.10(pid=20309): Launched 19:41:48.130854 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:41:48.335056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:48.642712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20310): Launched 19:41:48.910651 run iperf3-srv_10.42.42.10(pid=20311): Launched 19:41:49.026063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:41:49.230300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:49.538278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20312): Launched 19:41:49.805957 run iperf3-srv_10.42.42.10(pid=20313): Launched 19:41:49.920166 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:41:50.124123 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:41:50.431929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20314): Launched 19:41:50.699728 run iperf3-srv_10.42.42.10(pid=20315): Launched 19:41:50.815602 tst iperf3m4.py:8: start network... 19:41:51.020625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:51.495645 run create_hlr_db(pid=20316): Launched 19:41:51.622020 bus /gobi_6: Setting Powered False 19:41:52.683346 run create_hlr_db(pid=20316): Terminated: ok {rc=0} 19:41:53.134073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20318): Launched 19:41:53.463653 run osmo-hlr_10.42.42.2(pid=20319): Launched 19:41:53.592029 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:54.161479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20321): Launched 19:41:54.490259 run osmo-stp_10.42.42.5(pid=20322): Launched 19:41:54.618344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:41:55.186367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20324): Launched 19:41:55.311955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:41:55.590480 run patchelf(pid=20325): Launched 19:41:55.775323 run osmo-stp_10.42.42.5(pid=20322): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20322)] 19:41:55.914479 run osmo-stp_10.42.42.5(pid=20322): stdout: | (launched: 2022-12-12_19:41:54.429659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:56.055657 run osmo-stp_10.42.42.5(pid=20322): stderr: | 20221212194154622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194154622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194154623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194154623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194154624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194154624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194154624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:56.196922 run osmo-stp_10.42.42.5(pid=20322): stdout: | (launched: 2022-12-12_19:41:54.429659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:56.331558 run osmo-stp_10.42.42.5(pid=20322): stderr: | 20221212194154622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194154622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194154623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194154623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194154624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194154624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194154624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:56.491125 run patchelf(pid=20325): Terminating (SIGINT) 19:41:56.674850 run patchelf(pid=20325): Terminated: ok {rc=0} 19:41:56.807265 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20322): Process ended prematurely: osmo-stp_10.42.42.5(pid=20322) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20322)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 19:41:56.817580 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:41:56.847447 run osmo-hlr_10.42.42.2(pid=20319): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20319)] 19:41:56.899481 run osmo-hlr_10.42.42.2(pid=20319): stdout: | (launched: 2022-12-12_19:41:53.403200) 19:41:56.952781 run osmo-hlr_10.42.42.2(pid=20319): stderr: | 20221212194153604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194153604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194153604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194153604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194153604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194153604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194153617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194153627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194153627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194153627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:57.006507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Terminating (SIGTERM) 19:41:57.049323 run iperf3-srv_10.42.42.10(pid=20309): Terminating (SIGTERM) 19:41:57.092600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20310): Terminating (SIGTERM) 19:41:57.136351 run iperf3-srv_10.42.42.10(pid=20311): Terminating (SIGTERM) 19:41:57.179103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20312): Terminating (SIGTERM) 19:41:57.222020 run iperf3-srv_10.42.42.10(pid=20313): Terminating (SIGTERM) 19:41:57.264725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20314): Terminating (SIGTERM) 19:41:57.307610 run iperf3-srv_10.42.42.10(pid=20315): Terminating (SIGTERM) 19:41:57.350373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20318): Terminating (SIGTERM) 19:41:57.393189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20321): Terminating (SIGTERM) 19:41:57.435917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20324): Terminating (SIGTERM) 19:41:57.479262 --- ParallelTerminationStrategy: PID 20308 died... 19:41:57.499685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Terminated: ok {rc=0} 19:41:57.547734 --- ParallelTerminationStrategy: PID 20309 died... 19:41:57.567753 run iperf3-srv_10.42.42.10(pid=20309): Terminated {rc=256} 19:41:57.615403 --- ParallelTerminationStrategy: PID 20310 died... 19:41:57.635114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20310): Terminated: ok {rc=0} 19:41:57.682139 --- ParallelTerminationStrategy: PID 20311 died... 19:41:57.701874 run iperf3-srv_10.42.42.10(pid=20311): Terminated {rc=256} 19:41:57.749095 --- ParallelTerminationStrategy: PID 20312 died... 19:41:57.768829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20312): Terminated: ok {rc=0} 19:41:57.815962 --- ParallelTerminationStrategy: PID 20313 died... 19:41:57.835864 run iperf3-srv_10.42.42.10(pid=20313): Terminated {rc=256} 19:41:57.883390 --- ParallelTerminationStrategy: PID 20314 died... 19:41:57.903254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20314): Terminated: ok {rc=0} 19:41:57.950420 --- ParallelTerminationStrategy: PID 20315 died... 19:41:57.970301 run iperf3-srv_10.42.42.10(pid=20315): Terminated {rc=256} 19:41:58.017427 --- ParallelTerminationStrategy: PID 20318 died... 19:41:58.037318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20318): Terminated: ok {rc=0} 19:41:58.085452 --- ParallelTerminationStrategy: PID 20321 died... 19:41:58.105349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20321): Terminated: ok {rc=0} 19:41:58.153290 --- ParallelTerminationStrategy: PID 20324 died... 19:41:58.173590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20324): Terminated: ok {rc=0} 19:41:58.263645 bus /gobi_4: Setting Powered False 19:41:59.364252 bus /gobi_4: Setting Powered False 19:42:00.477865 bus /gobi_1: Setting Powered False 19:42:01.574829 bus /gobi_1: Setting Powered False 19:42:02.692173 bus /gobi_0: Setting Powered False 19:42:03.791954 bus /gobi_0: Setting Powered False 19:42:04.911757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 19:42:06.014177 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.026391 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:42:06.077835 tst ping.py: using LAC 31061 19:42:06.207249 tst ping.py: using RAC 206 19:42:06.331768 tst ping.py: using CellId 31061 19:42:06.455237 tst ping.py: using BVCI 31062 19:42:06.571952 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.583529 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.594928 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.606623 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.618133 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.629584 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.641379 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:06.653033 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:06.772663 tst ping.py:19: start network... 19:42:06.990697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:07.489216 run create_hlr_db(pid=20327): Launched 19:42:07.611299 bus /gobi_6: Setting Powered False 19:42:08.674483 run create_hlr_db(pid=20327): Terminated: ok {rc=0} 19:42:09.106036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20329): Launched 19:42:09.407186 run osmo-hlr_10.42.42.2(pid=20330): Launched 19:42:09.521086 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:10.042168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20332): Launched 19:42:10.342037 run osmo-stp_10.42.42.5(pid=20333): Launched 19:42:10.456069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:10.974682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20335): Launched 19:42:11.091195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:11.346658 run patchelf(pid=20336): Launched 19:42:11.515290 run osmo-stp_10.42.42.5(pid=20333): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20333)] 19:42:11.642497 run osmo-stp_10.42.42.5(pid=20333): stdout: | (launched: 2022-12-12_19:42:10.286567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:11.770911 run osmo-stp_10.42.42.5(pid=20333): stderr: | 20221212194210456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194210456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194210456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194210457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194210457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194210457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194210457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:11.900058 run osmo-stp_10.42.42.5(pid=20333): stdout: | (launched: 2022-12-12_19:42:10.286567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:12.022664 run osmo-stp_10.42.42.5(pid=20333): stderr: | 20221212194210456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194210456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194210456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194210457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194210457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194210457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194210457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:12.168332 run patchelf(pid=20336): Terminating (SIGINT) 19:42:12.335658 run patchelf(pid=20336): Terminated: ok {rc=0} 19:42:12.456325 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20333): Process ended prematurely: osmo-stp_10.42.42.5(pid=20333) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20333)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 19:42:12.465286 tst ping.py:22: Test FAILED (6.4 sec) 19:42:12.492201 run osmo-hlr_10.42.42.2(pid=20330): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20330)] 19:42:12.540215 run osmo-hlr_10.42.42.2(pid=20330): stdout: | (launched: 2022-12-12_19:42:09.351815) 19:42:12.590332 run osmo-hlr_10.42.42.2(pid=20330): stderr: | 20221212194209526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194209526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194209526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194209526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194209526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194209526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194209543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194209553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194209554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194209554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:12.640792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20329): Terminating (SIGTERM) 19:42:12.681414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20332): Terminating (SIGTERM) 19:42:12.721586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20335): Terminating (SIGTERM) 19:42:12.762074 --- ParallelTerminationStrategy: PID 20329 died... 19:42:12.781443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20329): Terminated: ok {rc=0} 19:42:12.826463 --- ParallelTerminationStrategy: PID 20332 died... 19:42:12.845300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20332): Terminated: ok {rc=0} 19:42:12.889370 --- ParallelTerminationStrategy: PID 20335 died... 19:42:12.908369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20335): Terminated: ok {rc=0} 19:42:12.993277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:42:14.081151 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.093877 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:42:14.151963 tst ping_idle_ping.py: using LAC 31062 19:42:14.277340 tst ping_idle_ping.py: using RAC 207 19:42:14.401723 tst ping_idle_ping.py: using CellId 31062 19:42:14.525856 tst ping_idle_ping.py: using BVCI 31063 19:42:14.642553 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.654293 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.665886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.677607 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.689220 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.700796 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.712727 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:42:14.724459 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:42:14.845635 tst ping_idle_ping.py:24: start network... 19:42:15.062804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:15.565745 run create_hlr_db(pid=20337): Launched 19:42:15.689886 bus /gobi_6: Setting Powered False 19:42:16.757580 run create_hlr_db(pid=20337): Terminated: ok {rc=0} 19:42:17.262231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20339): Launched 19:42:17.588261 run osmo-hlr_10.42.42.2(pid=20340): Launched 19:42:17.712766 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:18.271318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20342): Launched 19:42:18.594644 run osmo-stp_10.42.42.5(pid=20343): Launched 19:42:18.718607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:19.278422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20345): Launched 19:42:19.403395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:19.677980 run patchelf(pid=20346): Launched 19:42:19.859459 run osmo-stp_10.42.42.5(pid=20343): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20343)] 19:42:19.996378 run osmo-stp_10.42.42.5(pid=20343): stdout: | (launched: 2022-12-12_19:42:18.535514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:20.135732 run osmo-stp_10.42.42.5(pid=20343): stderr: | 20221212194218727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194218727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194218727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194218727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194218728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194218728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194218728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:20.274817 run osmo-stp_10.42.42.5(pid=20343): stdout: | (launched: 2022-12-12_19:42:18.535514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:20.407887 run osmo-stp_10.42.42.5(pid=20343): stderr: | 20221212194218727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194218727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194218727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194218727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194218728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194218728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194218728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:20.565656 run patchelf(pid=20346): Terminating (SIGINT) 19:42:20.745884 run patchelf(pid=20346): Terminated: ok {rc=0} 19:42:20.875496 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20343): Process ended prematurely: osmo-stp_10.42.42.5(pid=20343) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20343)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 19:42:20.885133 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:42:20.913767 run osmo-hlr_10.42.42.2(pid=20340): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20340)] 19:42:20.965055 run osmo-hlr_10.42.42.2(pid=20340): stdout: | (launched: 2022-12-12_19:42:17.528569) 19:42:21.018121 run osmo-hlr_10.42.42.2(pid=20340): stderr: | 20221212194217724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194217724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194217724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194217724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194217724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194217724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194217738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194217746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194217746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194217746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:21.071260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20339): Terminating (SIGTERM) 19:42:21.114011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20342): Terminating (SIGTERM) 19:42:21.156419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20345): Terminating (SIGTERM) 19:42:21.199235 --- ParallelTerminationStrategy: PID 20339 died... 19:42:21.219597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20339): Terminated: ok {rc=0} 19:42:21.266909 --- ParallelTerminationStrategy: PID 20342 died... 19:42:21.286790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20342): Terminated: ok {rc=0} 19:42:21.334511 --- ParallelTerminationStrategy: PID 20345 died... 19:42:21.354560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20345): Terminated: ok {rc=0} 19:42:21.445173 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:42:22.762092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:42:22.769491 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:42:22.803020 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:42:22.841664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:42:22.933180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:42:22.968816 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:42:23.008567 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:42:23.596690 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:42:23.646104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:23.657307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:42:23.725891 tst cs_paging_gprs_active.py: using LAC 31063 19:42:23.846308 tst cs_paging_gprs_active.py: using RAC 208 19:42:23.965007 tst cs_paging_gprs_active.py: using CellId 31063 19:42:24.083882 tst cs_paging_gprs_active.py: using BVCI 31064 19:42:24.194635 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.205746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.216555 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.227388 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.238238 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.248929 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.259872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.270623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:24.281681 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:24.402642 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:24.524887 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:42:24.748082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:25.079023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20350): Launched 19:42:25.368230 run iperf3-srv_10.42.42.10(pid=20351): Launched 19:42:25.491613 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:42:25.713454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:26.043606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Launched 19:42:26.334141 run iperf3-srv_10.42.42.10(pid=20353): Launched 19:42:26.457639 tst cs_paging_gprs_active.py:38: start network... 19:42:26.679377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:27.187714 run create_hlr_db(pid=20354): Launched 19:42:27.313804 bus /gobi_6: Setting Powered False 19:42:28.378595 run create_hlr_db(pid=20354): Terminated: ok {rc=0} 19:42:28.816798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20356): Launched 19:42:29.123795 run osmo-hlr_10.42.42.2(pid=20357): Launched 19:42:29.241124 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:29.769723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20359): Launched 19:42:30.075635 run osmo-stp_10.42.42.5(pid=20360): Launched 19:42:30.192862 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:30.722290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20362): Launched 19:42:30.845581 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:31.131976 run patchelf(pid=20363): Launched 19:42:31.333086 run osmo-stp_10.42.42.5(pid=20360): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20360)] 19:42:31.477185 run osmo-stp_10.42.42.5(pid=20360): stdout: | (launched: 2022-12-12_19:42:30.019156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:31.623716 run osmo-stp_10.42.42.5(pid=20360): stderr: | 20221212194230190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194230190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194230190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194230191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194230191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194230191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194230191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:31.770212 run osmo-stp_10.42.42.5(pid=20360): stdout: | (launched: 2022-12-12_19:42:30.019156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:31.909034 run osmo-stp_10.42.42.5(pid=20360): stderr: | 20221212194230190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194230190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194230190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194230191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194230191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194230191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194230191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:32.074136 run patchelf(pid=20363): Terminating (SIGINT) 19:42:32.262779 run patchelf(pid=20363): Terminated: ok {rc=0} 19:42:32.396396 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20360): Process ended prematurely: osmo-stp_10.42.42.5(pid=20360) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20360)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:42:32.407031 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:42:32.436744 run osmo-hlr_10.42.42.2(pid=20357): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20357)] 19:42:32.488027 run osmo-hlr_10.42.42.2(pid=20357): stdout: | (launched: 2022-12-12_19:42:29.067171) 19:42:32.541215 run osmo-hlr_10.42.42.2(pid=20357): stderr: | 20221212194229244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194229244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194229245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194229245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194229245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194229245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194229260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194229271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194229271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194229271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:32.594512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20350): Terminating (SIGTERM) 19:42:32.636904 run iperf3-srv_10.42.42.10(pid=20351): Terminating (SIGTERM) 19:42:32.679235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Terminating (SIGTERM) 19:42:32.721532 run iperf3-srv_10.42.42.10(pid=20353): Terminating (SIGTERM) 19:42:32.763753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20356): Terminating (SIGTERM) 19:42:32.806229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20359): Terminating (SIGTERM) 19:42:32.848672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20362): Terminating (SIGTERM) 19:42:32.891735 --- ParallelTerminationStrategy: PID 20350 died... 19:42:32.912038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20350): Terminated: ok {rc=0} 19:42:32.959341 --- ParallelTerminationStrategy: PID 20351 died... 19:42:32.979109 run iperf3-srv_10.42.42.10(pid=20351): Terminated {rc=256} 19:42:33.026204 --- ParallelTerminationStrategy: PID 20352 died... 19:42:33.046204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Terminated: ok {rc=0} 19:42:33.093842 --- ParallelTerminationStrategy: PID 20353 died... 19:42:33.113634 run iperf3-srv_10.42.42.10(pid=20353): Terminated {rc=256} 19:42:33.160859 --- ParallelTerminationStrategy: PID 20356 died... 19:42:33.180812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20356): Terminated: ok {rc=0} 19:42:33.227873 --- ParallelTerminationStrategy: PID 20359 died... 19:42:33.247745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20359): Terminated: ok {rc=0} 19:42:33.294950 --- ParallelTerminationStrategy: PID 20362 died... 19:42:33.314838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20362): Terminated: ok {rc=0} 19:42:33.404303 bus /gobi_0: Setting Powered False 19:42:34.505233 bus /gobi_0: Setting Powered False 19:42:35.625148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:42:36.776822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:36.789585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:42:36.865815 tst iperf3.py: using LAC 31064 19:42:36.995568 tst iperf3.py: using RAC 209 19:42:37.124334 tst iperf3.py: using CellId 31064 19:42:37.253123 tst iperf3.py: using BVCI 31065 19:42:37.372303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.384028 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.395520 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.407208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.418947 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.430624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.442414 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.454159 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:37.466188 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:37.587254 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:42:37.809797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:38.139771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20364): Launched 19:42:38.428342 run iperf3-srv_10.42.42.10(pid=20365): Launched 19:42:38.551615 tst iperf3.py:8: start network... 19:42:38.773331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:39.283198 run create_hlr_db(pid=20366): Launched 19:42:39.408333 bus /gobi_6: Setting Powered False 19:42:40.472699 run create_hlr_db(pid=20366): Terminated: ok {rc=0} 19:42:40.930699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20368): Launched 19:42:41.260009 run osmo-hlr_10.42.42.2(pid=20369): Launched 19:42:41.386282 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:41.954307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20371): Launched 19:42:42.282936 run osmo-stp_10.42.42.5(pid=20372): Launched 19:42:42.409539 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:42.974310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20374): Launched 19:42:43.100518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:43.379028 run patchelf(pid=20375): Launched 19:42:43.563590 run osmo-stp_10.42.42.5(pid=20372): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20372)] 19:42:43.703848 run osmo-stp_10.42.42.5(pid=20372): stdout: | (launched: 2022-12-12_19:42:42.222835) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:43.844697 run osmo-stp_10.42.42.5(pid=20372): stderr: | 20221212194242416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194242416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194242416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194242417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194242417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194242417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194242417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:43.986203 run osmo-stp_10.42.42.5(pid=20372): stdout: | (launched: 2022-12-12_19:42:42.222835) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:44.121777 run osmo-stp_10.42.42.5(pid=20372): stderr: | 20221212194242416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194242416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194242416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194242417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194242417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194242417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194242417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:44.282204 run patchelf(pid=20375): Terminating (SIGINT) 19:42:44.466672 run patchelf(pid=20375): Terminated: ok {rc=0} 19:42:44.600017 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20372): Process ended prematurely: osmo-stp_10.42.42.5(pid=20372) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20372)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 19:42:44.610502 tst iperf3.py:8: Test FAILED (7.9 sec) 19:42:44.640013 run osmo-hlr_10.42.42.2(pid=20369): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20369)] 19:42:44.691582 run osmo-hlr_10.42.42.2(pid=20369): stdout: | (launched: 2022-12-12_19:42:41.199744) 19:42:44.745145 run osmo-hlr_10.42.42.2(pid=20369): stderr: | 20221212194241398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194241398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194241398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194241399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194241399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194241399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194241412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194241422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194241422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194241422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:44.799273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20364): Terminating (SIGTERM) 19:42:44.842413 run iperf3-srv_10.42.42.10(pid=20365): Terminating (SIGTERM) 19:42:44.885406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20368): Terminating (SIGTERM) 19:42:44.928497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20371): Terminating (SIGTERM) 19:42:44.971613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20374): Terminating (SIGTERM) 19:42:45.015081 --- ParallelTerminationStrategy: PID 20364 died... 19:42:45.035510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20364): Terminated: ok {rc=0} 19:42:45.083560 --- ParallelTerminationStrategy: PID 20365 died... 19:42:45.103933 run iperf3-srv_10.42.42.10(pid=20365): Terminated {rc=256} 19:42:45.151312 --- ParallelTerminationStrategy: PID 20368 died... 19:42:45.171274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20368): Terminated: ok {rc=0} 19:42:45.218555 --- ParallelTerminationStrategy: PID 20371 died... 19:42:45.238504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20371): Terminated: ok {rc=0} 19:42:45.285598 --- ParallelTerminationStrategy: PID 20374 died... 19:42:45.305602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20374): Terminated: ok {rc=0} 19:42:45.394631 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:42:46.546672 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:46.559503 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:42:46.632486 tst iperf3m4.py: using LAC 31065 19:42:46.763305 tst iperf3m4.py: using RAC 210 19:42:46.894417 tst iperf3m4.py: using CellId 31065 19:42:47.025449 tst iperf3m4.py: using BVCI 31066 19:42:47.149140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.161994 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.175615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.188243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.200886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.213614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.226739 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.241732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:42:47.253585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:47.373810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:47.499103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:47.618265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:42:47.738600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:42:47.944548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:48.253601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20376): Launched 19:42:48.520927 run iperf3-srv_10.42.42.10(pid=20377): Launched 19:42:48.636384 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:42:48.841836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:49.150333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20378): Launched 19:42:49.419178 run iperf3-srv_10.42.42.10(pid=20379): Launched 19:42:49.535221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:42:49.740486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:50.049217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20380): Launched 19:42:50.316658 run iperf3-srv_10.42.42.10(pid=20381): Launched 19:42:50.431538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:42:50.635974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:50.944830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20382): Launched 19:42:51.213473 run iperf3-srv_10.42.42.10(pid=20383): Launched 19:42:51.327913 tst iperf3m4.py:8: start network... 19:42:51.533408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:52.027363 run create_hlr_db(pid=20384): Launched 19:42:52.153675 bus /gobi_6: Setting Powered False 19:42:53.215208 run create_hlr_db(pid=20384): Terminated: ok {rc=0} 19:42:53.645580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20386): Launched 19:42:53.952599 run osmo-hlr_10.42.42.2(pid=20387): Launched 19:42:54.069110 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:54.614293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20389): Launched 19:42:54.919537 run osmo-stp_10.42.42.5(pid=20390): Launched 19:42:55.035304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:55.562686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20392): Launched 19:42:55.681503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:55.940281 run patchelf(pid=20393): Launched 19:42:56.111073 run osmo-stp_10.42.42.5(pid=20390): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20390)] 19:42:56.240577 run osmo-stp_10.42.42.5(pid=20390): stdout: | (launched: 2022-12-12_19:42:54.863242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:56.372162 run osmo-stp_10.42.42.5(pid=20390): stderr: | 20221212194255034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194255034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194255034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194255034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194255035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194255035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194255035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:56.503899 run osmo-stp_10.42.42.5(pid=20390): stdout: | (launched: 2022-12-12_19:42:54.863242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:56.629568 run osmo-stp_10.42.42.5(pid=20390): stderr: | 20221212194255034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194255034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194255034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194255034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194255035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194255035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194255035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:56.778053 run patchelf(pid=20393): Terminating (SIGINT) 19:42:56.949749 run patchelf(pid=20393): Terminated: ok {rc=0} 19:42:57.073247 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20390): Process ended prematurely: osmo-stp_10.42.42.5(pid=20390) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20390)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:42:57.082838 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:42:57.110626 run osmo-hlr_10.42.42.2(pid=20387): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20387)] 19:42:57.158206 run osmo-hlr_10.42.42.2(pid=20387): stdout: | (launched: 2022-12-12_19:42:53.895940) 19:42:57.207878 run osmo-hlr_10.42.42.2(pid=20387): stderr: | 20221212194254075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194254075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194254075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194254075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194254075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194254075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194254088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194254097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194254097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194254097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:57.257983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20376): Terminating (SIGTERM) 19:42:57.297898 run iperf3-srv_10.42.42.10(pid=20377): Terminating (SIGTERM) 19:42:57.337881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20378): Terminating (SIGTERM) 19:42:57.377866 run iperf3-srv_10.42.42.10(pid=20379): Terminating (SIGTERM) 19:42:57.417689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20380): Terminating (SIGTERM) 19:42:57.457601 run iperf3-srv_10.42.42.10(pid=20381): Terminating (SIGTERM) 19:42:57.497362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20382): Terminating (SIGTERM) 19:42:57.537940 run iperf3-srv_10.42.42.10(pid=20383): Terminating (SIGTERM) 19:42:57.577896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20386): Terminating (SIGTERM) 19:42:57.617804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20389): Terminating (SIGTERM) 19:42:57.657617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20392): Terminating (SIGTERM) 19:42:57.697714 --- ParallelTerminationStrategy: PID 20376 died... 19:42:57.717046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20376): Terminated: ok {rc=0} 19:42:57.761937 --- ParallelTerminationStrategy: PID 20377 died... 19:42:57.780653 run iperf3-srv_10.42.42.10(pid=20377): Terminated {rc=256} 19:42:57.825305 --- ParallelTerminationStrategy: PID 20378 died... 19:42:57.844089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20378): Terminated: ok {rc=0} 19:42:57.889303 --- ParallelTerminationStrategy: PID 20379 died... 19:42:57.908116 run iperf3-srv_10.42.42.10(pid=20379): Terminated {rc=256} 19:42:57.952164 --- ParallelTerminationStrategy: PID 20380 died... 19:42:57.970983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20380): Terminated: ok {rc=0} 19:42:58.015592 --- ParallelTerminationStrategy: PID 20381 died... 19:42:58.034353 run iperf3-srv_10.42.42.10(pid=20381): Terminated {rc=256} 19:42:58.078538 --- ParallelTerminationStrategy: PID 20382 died... 19:42:58.097495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20382): Terminated: ok {rc=0} 19:42:58.142616 --- ParallelTerminationStrategy: PID 20383 died... 19:42:58.161453 run iperf3-srv_10.42.42.10(pid=20383): Terminated {rc=256} 19:42:58.205592 --- ParallelTerminationStrategy: PID 20386 died... 19:42:58.224214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20386): Terminated: ok {rc=0} 19:42:58.268823 --- ParallelTerminationStrategy: PID 20389 died... 19:42:58.288113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20389): Terminated: ok {rc=0} 19:42:58.332277 --- ParallelTerminationStrategy: PID 20392 died... 19:42:58.351369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20392): Terminated: ok {rc=0} 19:42:58.437278 bus /gobi_4: Setting Powered False 19:42:59.539207 bus /gobi_4: Setting Powered False 19:43:00.655822 bus /gobi_1: Setting Powered False 19:43:01.753588 bus /gobi_1: Setting Powered False 19:43:02.868720 bus /gobi_0: Setting Powered False 19:43:03.967635 bus /gobi_0: Setting Powered False 19:43:05.090232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:43:06.197116 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.209701 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:43:06.283558 tst ping.py: using LAC 31066 19:43:06.409108 tst ping.py: using RAC 211 19:43:06.534451 tst ping.py: using CellId 31066 19:43:06.659972 tst ping.py: using BVCI 31067 19:43:06.776538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.788222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.799902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.811798 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.823438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.835223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.847183 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:06.858922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:06.978729 tst ping.py:19: start network... 19:43:07.196562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:07.694650 run create_hlr_db(pid=20394): Launched 19:43:07.818489 bus /gobi_6: Setting Powered False 19:43:08.881910 run create_hlr_db(pid=20394): Terminated: ok {rc=0} 19:43:09.312919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Launched 19:43:09.612756 run osmo-hlr_10.42.42.2(pid=20397): Launched 19:43:09.726399 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:10.259062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Launched 19:43:10.558012 run osmo-stp_10.42.42.5(pid=20401): Launched 19:43:10.671620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:11.191049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20403): Launched 19:43:11.305412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:11.559395 run patchelf(pid=20404): Launched 19:43:11.726784 run osmo-stp_10.42.42.5(pid=20401): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] 19:43:11.853604 run osmo-stp_10.42.42.5(pid=20401): stdout: | (launched: 2022-12-12_19:43:10.502617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:11.982465 run osmo-stp_10.42.42.5(pid=20401): stderr: | 20221212194310671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194310672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194310672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194310672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194310673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194310673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194310673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:12.111366 run osmo-stp_10.42.42.5(pid=20401): stdout: | (launched: 2022-12-12_19:43:10.502617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:12.234356 run osmo-stp_10.42.42.5(pid=20401): stderr: | 20221212194310671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194310672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194310672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194310672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194310673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194310673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194310673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:12.379579 run patchelf(pid=20404): Terminating (SIGINT) 19:43:12.547292 run patchelf(pid=20404): Terminated: ok {rc=0} 19:43:12.668275 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20401): Process ended prematurely: osmo-stp_10.42.42.5(pid=20401) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 19:43:12.677178 tst ping.py:22: Test FAILED (6.5 sec) 19:43:12.704007 run osmo-hlr_10.42.42.2(pid=20397): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20397)] 19:43:12.752207 run osmo-hlr_10.42.42.2(pid=20397): stdout: | (launched: 2022-12-12_19:43:09.556822) 19:43:12.802320 run osmo-hlr_10.42.42.2(pid=20397): stderr: | 20221212194309734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194309734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194309734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194309734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194309734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194309734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194309746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194309755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194309756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194309756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:12.852883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Terminating (SIGTERM) 19:43:12.893237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Terminating (SIGTERM) 19:43:12.933689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20403): Terminating (SIGTERM) 19:43:12.974086 --- ParallelTerminationStrategy: PID 20396 died... 19:43:12.993381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Terminated: ok {rc=0} 19:43:13.037895 --- ParallelTerminationStrategy: PID 20400 died... 19:43:13.056720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Terminated: ok {rc=0} 19:43:13.101307 --- ParallelTerminationStrategy: PID 20403 died... 19:43:13.120072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20403): Terminated: ok {rc=0} 19:43:13.207032 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:43:14.297083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.309099 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:43:14.380660 tst ping_idle_ping.py: using LAC 31067 19:43:14.498149 tst ping_idle_ping.py: using RAC 212 19:43:14.620106 tst ping_idle_ping.py: using CellId 31067 19:43:14.738324 tst ping_idle_ping.py: using BVCI 31068 19:43:14.857900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.869871 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.881601 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.894164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.906519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.919275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.931676 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:43:14.944387 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:43:15.063348 tst ping_idle_ping.py:24: start network... 19:43:15.266516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:15.741883 run create_hlr_db(pid=20405): Launched 19:43:15.870064 bus /gobi_6: Setting Powered False 19:43:16.941793 run create_hlr_db(pid=20405): Terminated: ok {rc=0} 19:43:17.404284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20407): Launched 19:43:17.707188 run osmo-hlr_10.42.42.2(pid=20408): Launched 19:43:17.821251 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:18.342743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20410): Launched 19:43:18.645340 run osmo-stp_10.42.42.5(pid=20411): Launched 19:43:18.758815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:19.278052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20413): Launched 19:43:19.393352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:19.648157 run patchelf(pid=20414): Launched 19:43:19.817121 run osmo-stp_10.42.42.5(pid=20411): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20411)] 19:43:19.944460 run osmo-stp_10.42.42.5(pid=20411): stdout: | (launched: 2022-12-12_19:43:18.589734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:20.073411 run osmo-stp_10.42.42.5(pid=20411): stderr: | 20221212194318760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194318760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194318760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194318761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194318761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194318761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194318761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:20.202717 run osmo-stp_10.42.42.5(pid=20411): stdout: | (launched: 2022-12-12_19:43:18.589734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:20.325968 run osmo-stp_10.42.42.5(pid=20411): stderr: | 20221212194318760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194318760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194318760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194318761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194318761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194318761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194318761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:20.472170 run patchelf(pid=20414): Terminating (SIGINT) 19:43:20.639954 run patchelf(pid=20414): Terminated: ok {rc=0} 19:43:20.760773 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20411): Process ended prematurely: osmo-stp_10.42.42.5(pid=20411) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20411)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:43:20.769849 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:43:20.796620 run osmo-hlr_10.42.42.2(pid=20408): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20408)] 19:43:20.844668 run osmo-hlr_10.42.42.2(pid=20408): stdout: | (launched: 2022-12-12_19:43:17.650695) 19:43:20.894556 run osmo-hlr_10.42.42.2(pid=20408): stderr: | 20221212194317828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194317828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194317828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194317828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194317828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194317828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194317839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194317849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194317849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194317849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:20.944853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20407): Terminating (SIGTERM) 19:43:20.984877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20410): Terminating (SIGTERM) 19:43:21.024802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20413): Terminating (SIGTERM) 19:43:21.064774 --- ParallelTerminationStrategy: PID 20407 died... 19:43:21.083979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20407): Terminated: ok {rc=0} 19:43:21.128267 --- ParallelTerminationStrategy: PID 20410 died... 19:43:21.147001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20410): Terminated: ok {rc=0} 19:43:21.191766 --- ParallelTerminationStrategy: PID 20413 died... 19:43:21.210707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20413): Terminated: ok {rc=0} 19:43:21.294837 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:43:22.600620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:43:22.607273 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:43:22.641197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:43:22.679840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:43:22.765517 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:43:22.799364 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:43:22.837815 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:43:23.435110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:43:23.484994 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:23.496213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:43:23.565418 tst cs_paging_gprs_active.py: using LAC 31068 19:43:23.685823 tst cs_paging_gprs_active.py: using RAC 213 19:43:23.804780 tst cs_paging_gprs_active.py: using CellId 31068 19:43:23.923229 tst cs_paging_gprs_active.py: using BVCI 31069 19:43:24.036328 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.047653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.058792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.070218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.081482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.092721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.104144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.115466 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:24.126876 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:43:24.248609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:43:24.369550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:43:24.593469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:24.923497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20419): Launched 19:43:25.212393 run iperf3-srv_10.42.42.10(pid=20420): Launched 19:43:25.335699 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:43:25.557281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:25.889030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20421): Launched 19:43:26.176174 run iperf3-srv_10.42.42.10(pid=20422): Launched 19:43:26.299292 tst cs_paging_gprs_active.py:38: start network... 19:43:26.521565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:27.029922 run create_hlr_db(pid=20423): Launched 19:43:27.157798 bus /gobi_6: Setting Powered False 19:43:28.222865 run create_hlr_db(pid=20423): Terminated: ok {rc=0} 19:43:28.661823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20425): Launched 19:43:28.970719 run osmo-hlr_10.42.42.2(pid=20426): Launched 19:43:29.092749 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:29.633916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20428): Launched 19:43:29.940650 run osmo-stp_10.42.42.5(pid=20429): Launched 19:43:30.057555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:30.585636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20431): Launched 19:43:30.703140 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:30.965622 run patchelf(pid=20432): Launched 19:43:31.179719 run osmo-stp_10.42.42.5(pid=20429): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20429)] 19:43:31.323378 run osmo-stp_10.42.42.5(pid=20429): stdout: | (launched: 2022-12-12_19:43:29.884186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:31.470350 run osmo-stp_10.42.42.5(pid=20429): stderr: | 20221212194330052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194330052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194330053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194330053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194330054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194330054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194330054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:31.616905 run osmo-stp_10.42.42.5(pid=20429): stdout: | (launched: 2022-12-12_19:43:29.884186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:31.756073 run osmo-stp_10.42.42.5(pid=20429): stderr: | 20221212194330052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194330052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194330053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194330053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194330054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194330054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194330054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:31.921200 run patchelf(pid=20432): Terminating (SIGINT) 19:43:32.110705 run patchelf(pid=20432): Terminated: ok {rc=0} 19:43:32.246154 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20429): Process ended prematurely: osmo-stp_10.42.42.5(pid=20429) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20429)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:43:32.256553 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:43:32.286196 run osmo-hlr_10.42.42.2(pid=20426): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20426)] 19:43:32.337739 run osmo-hlr_10.42.42.2(pid=20426): stdout: | (launched: 2022-12-12_19:43:28.914141) 19:43:32.390634 run osmo-hlr_10.42.42.2(pid=20426): stderr: | 20221212194329091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194329091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194329092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194329092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194329092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194329092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194329102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194329111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194329111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194329111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:32.445236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20419): Terminating (SIGTERM) 19:43:32.485845 run iperf3-srv_10.42.42.10(pid=20420): Terminating (SIGTERM) 19:43:32.526098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20421): Terminating (SIGTERM) 19:43:32.566435 run iperf3-srv_10.42.42.10(pid=20422): Terminating (SIGTERM) 19:43:32.606648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20425): Terminating (SIGTERM) 19:43:32.646949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20428): Terminating (SIGTERM) 19:43:32.687534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20431): Terminating (SIGTERM) 19:43:32.727811 --- ParallelTerminationStrategy: PID 20419 died... 19:43:32.746583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20419): Terminated: ok {rc=0} 19:43:32.791820 --- ParallelTerminationStrategy: PID 20420 died... 19:43:32.810427 run iperf3-srv_10.42.42.10(pid=20420): Terminated {rc=256} 19:43:32.855226 --- ParallelTerminationStrategy: PID 20421 died... 19:43:32.873949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20421): Terminated: ok {rc=0} 19:43:32.918862 --- ParallelTerminationStrategy: PID 20422 died... 19:43:32.937446 run iperf3-srv_10.42.42.10(pid=20422): Terminated {rc=256} 19:43:32.982452 --- ParallelTerminationStrategy: PID 20425 died... 19:43:33.001162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20425): Terminated: ok {rc=0} 19:43:33.046330 --- ParallelTerminationStrategy: PID 20428 died... 19:43:33.065241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20428): Terminated: ok {rc=0} 19:43:33.110892 --- ParallelTerminationStrategy: PID 20431 died... 19:43:33.129702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20431): Terminated: ok {rc=0} 19:43:33.218455 bus /gobi_0: Setting Powered False 19:43:34.320518 bus /gobi_0: Setting Powered False 19:43:35.437999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:43:36.586635 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:36.598485 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:43:36.672508 tst iperf3.py: using LAC 31069 19:43:36.791913 tst iperf3.py: using RAC 214 19:43:36.912740 tst iperf3.py: using CellId 31069 19:43:37.031750 tst iperf3.py: using BVCI 31070 19:43:37.143846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.154933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.165937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.176826 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.187696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.198501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.209476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.220275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:37.231259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:43:37.350690 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:43:37.573625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:37.904253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20433): Launched 19:43:38.191695 run iperf3-srv_10.42.42.10(pid=20434): Launched 19:43:38.316799 tst iperf3.py:8: start network... 19:43:38.538894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:39.048532 run create_hlr_db(pid=20435): Launched 19:43:39.174631 bus /gobi_6: Setting Powered False 19:43:40.239810 run create_hlr_db(pid=20435): Terminated: ok {rc=0} 19:43:40.680153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20437): Launched 19:43:40.987641 run osmo-hlr_10.42.42.2(pid=20438): Launched 19:43:41.105108 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:41.633496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20440): Launched 19:43:41.941741 run osmo-stp_10.42.42.5(pid=20441): Launched 19:43:42.058613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:42.586333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20443): Launched 19:43:42.705241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:42.964268 run patchelf(pid=20444): Launched 19:43:43.135292 run osmo-stp_10.42.42.5(pid=20441): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20441)] 19:43:43.265319 run osmo-stp_10.42.42.5(pid=20441): stdout: | (launched: 2022-12-12_19:43:41.884450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:43.397625 run osmo-stp_10.42.42.5(pid=20441): stderr: | 20221212194342055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194342055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194342055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194342056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194342056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194342056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194342056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:43.529565 run osmo-stp_10.42.42.5(pid=20441): stdout: | (launched: 2022-12-12_19:43:41.884450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:43.655115 run osmo-stp_10.42.42.5(pid=20441): stderr: | 20221212194342055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194342055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194342055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194342056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194342056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194342056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194342056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:43.803764 run patchelf(pid=20444): Terminating (SIGINT) 19:43:43.977357 run patchelf(pid=20444): Terminated: ok {rc=0} 19:43:44.101788 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20441): Process ended prematurely: osmo-stp_10.42.42.5(pid=20441) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20441)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 19:43:44.111295 tst iperf3.py:8: Test FAILED (7.6 sec) 19:43:44.138741 run osmo-hlr_10.42.42.2(pid=20438): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20438)] 19:43:44.186953 run osmo-hlr_10.42.42.2(pid=20438): stdout: | (launched: 2022-12-12_19:43:40.931404) 19:43:44.237081 run osmo-hlr_10.42.42.2(pid=20438): stderr: | 20221212194341106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194341106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194341106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194341106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194341106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194341106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194341119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194341127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194341127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194341127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:44.287517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20433): Terminating (SIGTERM) 19:43:44.327949 run iperf3-srv_10.42.42.10(pid=20434): Terminating (SIGTERM) 19:43:44.368095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20437): Terminating (SIGTERM) 19:43:44.408761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20440): Terminating (SIGTERM) 19:43:44.449466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20443): Terminating (SIGTERM) 19:43:44.490008 --- ParallelTerminationStrategy: PID 20433 died... 19:43:44.509457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20433): Terminated: ok {rc=0} 19:43:44.554200 --- ParallelTerminationStrategy: PID 20434 died... 19:43:44.573066 run iperf3-srv_10.42.42.10(pid=20434): Terminated {rc=256} 19:43:44.617846 --- ParallelTerminationStrategy: PID 20437 died... 19:43:44.636542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20437): Terminated: ok {rc=0} 19:43:44.681141 --- ParallelTerminationStrategy: PID 20440 died... 19:43:44.700151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20440): Terminated: ok {rc=0} 19:43:44.744482 --- ParallelTerminationStrategy: PID 20443 died... 19:43:44.763297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20443): Terminated: ok {rc=0} 19:43:44.848300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:43:46.008399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.021602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:43:46.095170 tst iperf3m4.py: using LAC 31070 19:43:46.219689 tst iperf3m4.py: using RAC 215 19:43:46.344507 tst iperf3m4.py: using CellId 31070 19:43:46.484845 tst iperf3m4.py: using BVCI 31071 19:43:46.633698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.648609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.663007 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.678101 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.692262 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.704125 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.717909 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.732218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:43:46.746568 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:43:46.885639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:43:47.005792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:43:47.144103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:43:47.262511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:43:47.472728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:47.782292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20445): Launched 19:43:48.053342 run iperf3-srv_10.42.42.10(pid=20446): Launched 19:43:48.167924 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:43:48.371733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:48.678469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20447): Launched 19:43:48.947051 run iperf3-srv_10.42.42.10(pid=20448): Launched 19:43:49.061737 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:43:49.265777 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:49.573375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20449): Launched 19:43:49.839833 run iperf3-srv_10.42.42.10(pid=20450): Launched 19:43:49.955048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:43:50.159176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:50.466438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20451): Launched 19:43:50.734913 run iperf3-srv_10.42.42.10(pid=20452): Launched 19:43:50.849228 tst iperf3m4.py:8: start network... 19:43:51.053637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:51.527262 run create_hlr_db(pid=20453): Launched 19:43:51.652208 bus /gobi_6: Setting Powered False 19:43:52.712575 run create_hlr_db(pid=20453): Terminated: ok {rc=0} 19:43:53.159341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20455): Launched 19:43:53.488793 run osmo-hlr_10.42.42.2(pid=20456): Launched 19:43:53.616079 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:54.183522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20458): Launched 19:43:54.513542 run osmo-stp_10.42.42.5(pid=20459): Launched 19:43:54.639770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:55.208388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20461): Launched 19:43:55.334595 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:55.612532 run patchelf(pid=20462): Launched 19:43:55.796467 run osmo-stp_10.42.42.5(pid=20459): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20459)] 19:43:55.935904 run osmo-stp_10.42.42.5(pid=20459): stdout: | (launched: 2022-12-12_19:43:54.453199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:56.077297 run osmo-stp_10.42.42.5(pid=20459): stderr: | 20221212194354644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194354644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194354644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194354645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194354645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194354646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194354646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:56.219213 run osmo-stp_10.42.42.5(pid=20459): stdout: | (launched: 2022-12-12_19:43:54.453199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:56.354201 run osmo-stp_10.42.42.5(pid=20459): stderr: | 20221212194354644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194354644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194354644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194354645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194354645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194354646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194354646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:56.514321 run patchelf(pid=20462): Terminating (SIGINT) 19:43:56.697757 run patchelf(pid=20462): Terminated: ok {rc=0} 19:43:56.830375 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20459): Process ended prematurely: osmo-stp_10.42.42.5(pid=20459) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20459)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:43:56.841002 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:43:56.871465 run osmo-hlr_10.42.42.2(pid=20456): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20456)] 19:43:56.922784 run osmo-hlr_10.42.42.2(pid=20456): stdout: | (launched: 2022-12-12_19:43:53.428728) 19:43:56.976036 run osmo-hlr_10.42.42.2(pid=20456): stderr: | 20221212194353627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194353628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194353628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194353628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194353628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194353628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194353641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194353649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194353649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194353649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:57.029573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20445): Terminating (SIGTERM) 19:43:57.072647 run iperf3-srv_10.42.42.10(pid=20446): Terminating (SIGTERM) 19:43:57.115859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20447): Terminating (SIGTERM) 19:43:57.159235 run iperf3-srv_10.42.42.10(pid=20448): Terminating (SIGTERM) 19:43:57.202549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20449): Terminating (SIGTERM) 19:43:57.245690 run iperf3-srv_10.42.42.10(pid=20450): Terminating (SIGTERM) 19:43:57.288548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20451): Terminating (SIGTERM) 19:43:57.332124 run iperf3-srv_10.42.42.10(pid=20452): Terminating (SIGTERM) 19:43:57.375109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20455): Terminating (SIGTERM) 19:43:57.418159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20458): Terminating (SIGTERM) 19:43:57.461224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20461): Terminating (SIGTERM) 19:43:57.504504 --- ParallelTerminationStrategy: PID 20445 died... 19:43:57.525169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20445): Terminated: ok {rc=0} 19:43:57.573709 --- ParallelTerminationStrategy: PID 20446 died... 19:43:57.593759 run iperf3-srv_10.42.42.10(pid=20446): Terminated {rc=256} 19:43:57.641515 --- ParallelTerminationStrategy: PID 20447 died... 19:43:57.661647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20447): Terminated: ok {rc=0} 19:43:57.709859 --- ParallelTerminationStrategy: PID 20448 died... 19:43:57.730026 run iperf3-srv_10.42.42.10(pid=20448): Terminated {rc=256} 19:43:57.778284 --- ParallelTerminationStrategy: PID 20449 died... 19:43:57.798313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20449): Terminated: ok {rc=0} 19:43:57.846833 --- ParallelTerminationStrategy: PID 20450 died... 19:43:57.866975 run iperf3-srv_10.42.42.10(pid=20450): Terminated {rc=256} 19:43:57.915177 --- ParallelTerminationStrategy: PID 20451 died... 19:43:57.935343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20451): Terminated: ok {rc=0} 19:43:57.984087 --- ParallelTerminationStrategy: PID 20452 died... 19:43:58.004214 run iperf3-srv_10.42.42.10(pid=20452): Terminated {rc=256} 19:43:58.052008 --- ParallelTerminationStrategy: PID 20455 died... 19:43:58.071925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20455): Terminated: ok {rc=0} 19:43:58.119657 --- ParallelTerminationStrategy: PID 20458 died... 19:43:58.140017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20458): Terminated: ok {rc=0} 19:43:58.188073 --- ParallelTerminationStrategy: PID 20461 died... 19:43:58.208318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20461): Terminated: ok {rc=0} 19:43:58.299286 bus /gobi_4: Setting Powered False 19:43:59.402320 bus /gobi_4: Setting Powered False 19:44:00.524205 bus /gobi_1: Setting Powered False 19:44:01.630122 bus /gobi_1: Setting Powered False 19:44:02.751825 bus /gobi_0: Setting Powered False 19:44:03.852788 bus /gobi_0: Setting Powered False 19:44:04.972060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:44:06.076873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.090104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:44:06.165277 tst ping.py: using LAC 31071 19:44:06.293329 tst ping.py: using RAC 216 19:44:06.412028 tst ping.py: using CellId 31071 19:44:06.531681 tst ping.py: using BVCI 31072 19:44:06.642585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.653991 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.665062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.676590 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.687968 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.698870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.710844 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:06.722343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:44:06.838925 tst ping.py:19: start network... 19:44:07.040555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:07.505579 run create_hlr_db(pid=20463): Launched 19:44:07.629110 bus /gobi_6: Setting Powered False 19:44:08.689645 run create_hlr_db(pid=20463): Terminated: ok {rc=0} 19:44:09.131664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20465): Launched 19:44:09.432790 run osmo-hlr_10.42.42.2(pid=20466): Launched 19:44:09.547659 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:10.083996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20468): Launched 19:44:10.385361 run osmo-stp_10.42.42.5(pid=20469): Launched 19:44:10.499157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:11.017382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20471): Launched 19:44:11.133915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:11.387177 run patchelf(pid=20472): Launched 19:44:11.553088 run osmo-stp_10.42.42.5(pid=20469): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20469)] 19:44:11.679948 run osmo-stp_10.42.42.5(pid=20469): stdout: | (launched: 2022-12-12_19:44:10.329685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:11.808756 run osmo-stp_10.42.42.5(pid=20469): stderr: | 20221212194410498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194410498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194410498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194410498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194410499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194410499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194410499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:11.937524 run osmo-stp_10.42.42.5(pid=20469): stdout: | (launched: 2022-12-12_19:44:10.329685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:12.060223 run osmo-stp_10.42.42.5(pid=20469): stderr: | 20221212194410498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194410498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194410498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194410498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194410499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194410499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194410499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:12.206476 run patchelf(pid=20472): Terminating (SIGINT) 19:44:12.373760 run patchelf(pid=20472): Terminated: ok {rc=0} 19:44:12.494652 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20469): Process ended prematurely: osmo-stp_10.42.42.5(pid=20469) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20469)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 19:44:12.503530 tst ping.py:22: Test FAILED (6.4 sec) 19:44:12.530581 run osmo-hlr_10.42.42.2(pid=20466): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20466)] 19:44:12.578889 run osmo-hlr_10.42.42.2(pid=20466): stdout: | (launched: 2022-12-12_19:44:09.377196) 19:44:12.628580 run osmo-hlr_10.42.42.2(pid=20466): stderr: | 20221212194409552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194409552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194409552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194409552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194409552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194409552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194409564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194409574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194409574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194409574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:12.678764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20465): Terminating (SIGTERM) 19:44:12.718888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20468): Terminating (SIGTERM) 19:44:12.759164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20471): Terminating (SIGTERM) 19:44:12.799789 --- ParallelTerminationStrategy: PID 20465 died... 19:44:12.819312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20465): Terminated: ok {rc=0} 19:44:12.864049 --- ParallelTerminationStrategy: PID 20468 died... 19:44:12.882808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20468): Terminated: ok {rc=0} 19:44:12.927008 --- ParallelTerminationStrategy: PID 20471 died... 19:44:12.945843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20471): Terminated: ok {rc=0} 19:44:13.030554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:44:14.117327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.130318 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:44:14.207454 tst ping_idle_ping.py: using LAC 31072 19:44:14.334950 tst ping_idle_ping.py: using RAC 217 19:44:14.461273 tst ping_idle_ping.py: using CellId 31072 19:44:14.589385 tst ping_idle_ping.py: using BVCI 31073 19:44:14.706503 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.718135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.729650 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.741555 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.753209 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.764928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.776747 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:44:14.788571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:44:14.905849 tst ping_idle_ping.py:24: start network... 19:44:15.109093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:15.579347 run create_hlr_db(pid=20473): Launched 19:44:15.702781 bus /gobi_6: Setting Powered False 19:44:16.767163 run create_hlr_db(pid=20473): Terminated: ok {rc=0} 19:44:17.232134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20475): Launched 19:44:17.565179 run osmo-hlr_10.42.42.2(pid=20476): Launched 19:44:17.690808 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:18.249811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20478): Launched 19:44:18.572378 run osmo-stp_10.42.42.5(pid=20479): Launched 19:44:18.697401 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:19.257726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20481): Launched 19:44:19.382068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:19.656107 run patchelf(pid=20482): Launched 19:44:19.835996 run osmo-stp_10.42.42.5(pid=20479): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20479)] 19:44:19.973190 run osmo-stp_10.42.42.5(pid=20479): stdout: | (launched: 2022-12-12_19:44:18.513267) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:20.112451 run osmo-stp_10.42.42.5(pid=20479): stderr: | 20221212194418704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194418705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194418705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194418705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194418706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194418706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194418706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:20.252312 run osmo-stp_10.42.42.5(pid=20479): stdout: | (launched: 2022-12-12_19:44:18.513267) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:20.385727 run osmo-stp_10.42.42.5(pid=20479): stderr: | 20221212194418704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194418705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194418705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194418705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194418706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194418706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194418706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:20.543734 run patchelf(pid=20482): Terminating (SIGINT) 19:44:20.724481 run patchelf(pid=20482): Terminated: ok {rc=0} 19:44:20.855002 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20479): Process ended prematurely: osmo-stp_10.42.42.5(pid=20479) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20479)] [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:44:20.864735 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:44:20.893899 run osmo-hlr_10.42.42.2(pid=20476): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20476)] 19:44:20.945232 run osmo-hlr_10.42.42.2(pid=20476): stdout: | (launched: 2022-12-12_19:44:17.505959) 19:44:20.998188 run osmo-hlr_10.42.42.2(pid=20476): stderr: | 20221212194417704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194417704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194417704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194417704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194417704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194417704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194417717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194417725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194417725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194417725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:21.051796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20475): Terminating (SIGTERM) 19:44:21.094690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20478): Terminating (SIGTERM) 19:44:21.137936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20481): Terminating (SIGTERM) 19:44:21.180938 --- ParallelTerminationStrategy: PID 20475 died... 19:44:21.201499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20475): Terminated: ok {rc=0} 19:44:21.248932 --- ParallelTerminationStrategy: PID 20478 died... 19:44:21.268872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20478): Terminated: ok {rc=0} 19:44:21.316389 --- ParallelTerminationStrategy: PID 20481 died... 19:44:21.336329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20481): Terminated: ok {rc=0} 19:44:21.425246 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:44:22.733584 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:22.740320 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:44:22.775435 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:44:22.810384 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:44:22.865005 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:44:22.899347 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:44:22.933708 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:44:23.491912 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:44:23.496903 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:23.508642 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:44:23.580383 tst switch_tch_pdch.py: using LAC 31073 19:44:23.700573 tst switch_tch_pdch.py: using RAC 218 19:44:23.819920 tst switch_tch_pdch.py: using CellId 31073 19:44:23.937433 tst switch_tch_pdch.py: using BVCI 31074 19:44:24.045797 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:24.057127 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:24.068278 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:24.079540 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:24.090765 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:24.101855 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:24.113238 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:44:24.124386 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:44:24.241211 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:44:24.359431 tst switch_tch_pdch.py:51: start network... 19:44:24.576590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:25.075373 run create_hlr_db(pid=20486): Launched 19:44:25.199784 bus /gobi_6: Setting Powered False 19:44:26.264394 run create_hlr_db(pid=20486): Terminated: ok {rc=0} 19:44:26.695901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20488): Launched 19:44:26.997047 run osmo-hlr_10.42.42.2(pid=20489): Launched 19:44:27.111867 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:27.643291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20491): Launched 19:44:27.942580 run osmo-stp_10.42.42.5(pid=20492): Launched 19:44:28.057873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:28.575046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20494): Launched 19:44:28.690856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:28.943823 run patchelf(pid=20495): Launched 19:44:29.110574 run osmo-stp_10.42.42.5(pid=20492): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20492)] 19:44:29.236941 run osmo-stp_10.42.42.5(pid=20492): stdout: | (launched: 2022-12-12_19:44:27.887144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:29.365521 run osmo-stp_10.42.42.5(pid=20492): stderr: | 20221212194428054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194428055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194428055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194428055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194428056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194428056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194428056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:29.494385 run osmo-stp_10.42.42.5(pid=20492): stdout: | (launched: 2022-12-12_19:44:27.887144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:29.616619 run osmo-stp_10.42.42.5(pid=20492): stderr: | 20221212194428054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194428055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194428055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194428055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194428056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194428056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194428056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:29.762439 run patchelf(pid=20495): Terminating (SIGINT) 19:44:29.929967 run patchelf(pid=20495): Terminated: ok {rc=0} 19:44:30.050784 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20492): Process ended prematurely: osmo-stp_10.42.42.5(pid=20492) [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20492)] [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:44:30.059739 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 19:44:30.086443 run osmo-hlr_10.42.42.2(pid=20489): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20489)] 19:44:30.134214 run osmo-hlr_10.42.42.2(pid=20489): stdout: | (launched: 2022-12-12_19:44:26.941455) 19:44:30.183806 run osmo-hlr_10.42.42.2(pid=20489): stderr: | 20221212194427116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194427116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194427116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194427116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194427116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194427117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194427129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194427139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194427139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194427139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:30.233837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20488): Terminating (SIGTERM) 19:44:30.274245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20491): Terminating (SIGTERM) 19:44:30.314086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20494): Terminating (SIGTERM) 19:44:30.354176 --- ParallelTerminationStrategy: PID 20488 died... 19:44:30.373319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20488): Terminated: ok {rc=0} 19:44:30.418693 --- ParallelTerminationStrategy: PID 20491 died... 19:44:30.437428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20491): Terminated: ok {rc=0} 19:44:30.481564 --- ParallelTerminationStrategy: PID 20494 died... 19:44:30.500270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20494): Terminated: ok {rc=0} 19:44:30.587547 bus /gobi_0: Setting Powered False 19:44:31.700860 bus /gobi_0: Setting Powered False 19:44:32.835679 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:44:34.095090 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:34.101695 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:44:34.137468 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:44:34.174096 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:44:34.230051 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:44:34.265711 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:44:34.301222 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:44:34.857432 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:44:34.863681 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:34.875719 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:44:34.951087 tst switch_tch_pdch.py: using LAC 31074 19:44:35.078503 tst switch_tch_pdch.py: using RAC 219 19:44:35.205342 tst switch_tch_pdch.py: using CellId 31074 19:44:35.330780 tst switch_tch_pdch.py: using BVCI 31075 19:44:35.447735 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:35.459343 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:35.470851 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:35.483117 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:35.495251 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:35.507464 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:35.519720 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:44:35.532040 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:44:35.655587 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:44:35.775999 tst switch_tch_pdch.py:51: start network... 19:44:35.994014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:36.466988 run create_hlr_db(pid=20500): Launched 19:44:36.591743 bus /gobi_6: Setting Powered False 19:44:37.655700 run create_hlr_db(pid=20500): Terminated: ok {rc=0} 19:44:38.062536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20502): Launched 19:44:38.364764 run osmo-hlr_10.42.42.2(pid=20503): Launched 19:44:38.479243 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:38.971344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20505): Launched 19:44:39.270909 run osmo-stp_10.42.42.5(pid=20506): Launched 19:44:39.385554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:39.877853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20508): Launched 19:44:39.992770 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:40.246848 run patchelf(pid=20509): Launched 19:44:40.415880 run osmo-stp_10.42.42.5(pid=20506): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20506)] 19:44:40.543233 run osmo-stp_10.42.42.5(pid=20506): stdout: | (launched: 2022-12-12_19:44:39.215334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:40.672180 run osmo-stp_10.42.42.5(pid=20506): stderr: | 20221212194439387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194439387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194439388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194439388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194439389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194439389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194439389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:40.801487 run osmo-stp_10.42.42.5(pid=20506): stdout: | (launched: 2022-12-12_19:44:39.215334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:40.924142 run osmo-stp_10.42.42.5(pid=20506): stderr: | 20221212194439387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194439387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194439388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194439388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194439389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194439389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194439389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:41.069923 run patchelf(pid=20509): Terminating (SIGINT) 19:44:41.238525 run patchelf(pid=20509): Terminated: ok {rc=0} 19:44:41.359517 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20506): Process ended prematurely: osmo-stp_10.42.42.5(pid=20506) [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20506)] [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:44:41.368495 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 19:44:41.395345 run osmo-hlr_10.42.42.2(pid=20503): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20503)] 19:44:41.443424 run osmo-hlr_10.42.42.2(pid=20503): stdout: | (launched: 2022-12-12_19:44:38.308187) 19:44:41.493258 run osmo-hlr_10.42.42.2(pid=20503): stderr: | 20221212194438484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194438484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194438484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194438484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194438484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194438484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194438496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194438505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194438505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194438505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:41.543313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20502): Terminating (SIGTERM) 19:44:41.583172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20505): Terminating (SIGTERM) 19:44:41.622975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20508): Terminating (SIGTERM) 19:44:41.663259 --- ParallelTerminationStrategy: PID 20502 died... 19:44:41.682599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20502): Terminated: ok {rc=0} 19:44:41.726830 --- ParallelTerminationStrategy: PID 20505 died... 19:44:41.745494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20505): Terminated: ok {rc=0} 19:44:41.789504 --- ParallelTerminationStrategy: PID 20508 died... 19:44:41.808286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20508): Terminated: ok {rc=0} 19:44:41.895792 bus /gobi_0: Setting Powered False 19:44:43.000310 bus /gobi_0: Setting Powered False 19:44:44.119000 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_sms:trx-umtrx --------------------------------------------------------------------- 19:44:45.378404 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:45.382816 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:44:45.416343 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 19:44:45.423577 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 19:44:45.478618 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:44:45.513375 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 19:44:45.520467 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 19:44:46.054048 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 19:44:46.063854 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 19:44:46.080641 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 19:44:46.132086 tst mo_mt_sms.py: using LAC 31075 19:44:46.253431 tst mo_mt_sms.py: using RAC 220 19:44:46.418480 tst mo_mt_sms.py: using CellId 31075 19:44:46.547611 tst mo_mt_sms.py: using BVCI 31076 19:44:46.697961 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:44:46.821709 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:44:46.935225 tst mo_mt_sms.py:9: start nitb and bts... 19:44:47.144168 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:44:47.764405 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20513): Launched 19:44:48.066636 run osmo-nitb_10.42.42.2(pid=20514): Launched 19:44:48.235246 run osmo-nitb_10.42.42.2(pid=20514): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20514)] 19:44:48.371088 run osmo-nitb_10.42.42.2(pid=20514): stdout: | (launched: 2022-12-12_19:44:48.011028) 19:44:48.508681 run osmo-nitb_10.42.42.2(pid=20514): stderr: | (launched: 2022-12-12_19:44:48.055547) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:44:48.645615 run osmo-nitb_10.42.42.2(pid=20514): stdout: | (launched: 2022-12-12_19:44:48.011028) 19:44:48.776774 run osmo-nitb_10.42.42.2(pid=20514): stderr: | (launched: 2022-12-12_19:44:48.055547) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20514) [trial-2381↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20514)] 19:44:49.182498 tst osmo-nitb_10.42.42.2(pid=20514): stdout: | (launched: 2022-12-12_19:44:48.011028) 19:44:49.304742 tst osmo-nitb_10.42.42.2(pid=20514): stderr: | (launched: 2022-12-12_19:44:48.055547) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:44:49.448475 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20514) [trial-2381↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20514)] [trial-2381↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 19:44:49.457530 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 19:44:49.464208 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20513): Terminating (SIGTERM) 19:44:49.673356 --- ParallelTerminationStrategy: PID 20513 died... 19:44:49.694068 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20513): Terminated: ok {rc=0} 19:44:49.781105 bus /sierra_3: Setting Powered False 19:44:50.884126 bus /sierra_3: Setting Powered False 19:44:52.003340 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:trx-umtrx --------------------------------------------------------------------- 19:44:53.201534 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:53.205696 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:44:53.238435 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:44:53.265004 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 19:44:53.318293 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:44:53.350863 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:44:53.377116 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 19:44:53.920698 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 19:44:53.925640 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:44:53.936121 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 19:44:53.982758 tst mo_mt_sms.py: using LAC 31076 19:44:54.102230 tst mo_mt_sms.py: using RAC 221 19:44:54.221049 tst mo_mt_sms.py: using CellId 31076 19:44:54.337753 tst mo_mt_sms.py: using BVCI 31077 19:44:54.445719 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:44:54.456378 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:44:54.467036 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:44:54.477498 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:44:54.488038 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:44:54.498458 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:44:54.611506 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:44:54.729738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:55.229392 run create_hlr_db(pid=20518): Launched 19:44:55.353472 bus /sierra_2: Setting Powered False 19:44:56.413694 run create_hlr_db(pid=20518): Terminated: ok {rc=0} 19:44:56.864275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20520): Launched 19:44:57.188120 run osmo-hlr_10.42.42.2(pid=20521): Launched 19:44:57.311772 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:57.869448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20523): Launched 19:44:58.192715 run osmo-stp_10.42.42.5(pid=20524): Launched 19:44:58.316748 run osmo-msc_10.42.42.6: Starting osmo-msc 19:44:58.901647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20526): Launched 19:44:59.225415 run osmo-msc_10.42.42.6(pid=20527): Launched 19:44:59.406355 run osmo-stp_10.42.42.5(pid=20524): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20524)] 19:44:59.543272 run osmo-stp_10.42.42.5(pid=20524): stdout: | (launched: 2022-12-12_19:44:58.133123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:59.680842 run osmo-stp_10.42.42.5(pid=20524): stderr: | 20221212194458325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194458326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194458326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194458326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194458327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194458327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194458327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:59.817291 run osmo-stp_10.42.42.5(pid=20524): stdout: | (launched: 2022-12-12_19:44:58.133123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:59.945956 run osmo-stp_10.42.42.5(pid=20524): stderr: | 20221212194458325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194458326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194458326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194458326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194458327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194458327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194458327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:00.100162 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20524): Process ended prematurely: osmo-stp_10.42.42.5(pid=20524) [trial-2381↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20524)] [trial-2381↪sms:trx-umtrx↪mo_mt_sms.py:16] 19:45:00.109512 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 19:45:00.137588 run osmo-hlr_10.42.42.2(pid=20521): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20521)] 19:45:00.189259 run osmo-hlr_10.42.42.2(pid=20521): stdout: | (launched: 2022-12-12_19:44:57.128549) 19:45:00.242175 run osmo-hlr_10.42.42.2(pid=20521): stderr: | 20221212194457326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194457326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194457326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194457326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194457326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194457326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194457338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194457347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194457347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194457347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:00.315565 run osmo-msc_10.42.42.6(pid=20527): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20527)] 19:45:00.366612 run osmo-msc_10.42.42.6(pid=20527): stdout: | (launched: 2022-12-12_19:44:59.165951) 19:45:00.419350 run osmo-msc_10.42.42.6(pid=20527): stderr: | 20221212194459486 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194459486 DLGLOBAL DEBUG validating counter group 0x7fb25e34cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194459486 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194459486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194459486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194459487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194459488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194459489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194459489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194459489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:00.472615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20520): Terminating (SIGTERM) 19:45:00.515598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20523): Terminating (SIGTERM) 19:45:00.558493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20526): Terminating (SIGTERM) 19:45:00.601779 --- ParallelTerminationStrategy: PID 20520 died... 19:45:00.622071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20520): Terminated: ok {rc=0} 19:45:00.670076 --- ParallelTerminationStrategy: PID 20523 died... 19:45:00.689971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20523): Terminated: ok {rc=0} 19:45:00.737570 --- ParallelTerminationStrategy: PID 20526 died... 19:45:00.757607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20526): Terminated: ok {rc=0} 19:45:00.847881 bus /sierra_3: Setting Powered False 19:45:01.968714 bus /sierra_3: Setting Powered False 19:45:03.097763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 19:45:04.333353 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:04.337861 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:45:04.370271 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 19:45:04.377090 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 19:45:04.412404 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:45:04.445221 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 19:45:04.452102 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 19:45:04.974520 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 19:45:04.979778 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 19:45:04.991003 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 19:45:05.043561 tst assert_extension.py: using LAC 31077 19:45:05.168102 tst assert_extension.py: using RAC 222 19:45:05.291821 tst assert_extension.py: using CellId 31077 19:45:05.415080 tst assert_extension.py: using BVCI 31078 19:45:05.532618 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 19:45:05.648813 tst assert_extension.py:10: start nitb and bts... 19:45:05.850416 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:45:06.465775 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20535): Launched 19:45:06.766497 run osmo-nitb_10.42.42.2(pid=20536): Launched 19:45:06.934755 run osmo-nitb_10.42.42.2(pid=20536): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20536)] 19:45:07.070138 run osmo-nitb_10.42.42.2(pid=20536): stdout: | (launched: 2022-12-12_19:45:06.711066) 19:45:07.206760 run osmo-nitb_10.42.42.2(pid=20536): stderr: | (launched: 2022-12-12_19:45:06.755637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:45:07.343314 run osmo-nitb_10.42.42.2(pid=20536): stdout: | (launched: 2022-12-12_19:45:06.711066) 19:45:07.474390 run osmo-nitb_10.42.42.2(pid=20536): stderr: | (launched: 2022-12-12_19:45:06.755637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20536) [trial-2381↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20536)] 19:45:07.882392 tst osmo-nitb_10.42.42.2(pid=20536): stdout: | (launched: 2022-12-12_19:45:06.711066) 19:45:08.013349 tst osmo-nitb_10.42.42.2(pid=20536): stderr: | (launched: 2022-12-12_19:45:06.755637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:45:08.167979 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20536) [trial-2381↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20536)] [trial-2381↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 19:45:08.177509 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:45:08.184762 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20535): Terminating (SIGTERM) 19:45:08.397878 --- ParallelTerminationStrategy: PID 20535 died... 19:45:08.420349 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20535): Terminated: ok {rc=0} 19:45:08.511219 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:trx-umtrx --------------------------------------------------------------------- 19:45:09.690317 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:09.694210 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:45:09.726423 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:45:09.753027 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 19:45:09.787572 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:45:09.820183 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:45:09.846941 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 19:45:10.375478 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 19:45:10.380626 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:45:10.391379 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 19:45:10.442620 tst assert_extension.py: using LAC 31078 19:45:10.560878 tst assert_extension.py: using RAC 223 19:45:10.678649 tst assert_extension.py: using CellId 31078 19:45:10.795633 tst assert_extension.py: using BVCI 31079 19:45:10.905995 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:45:10.916602 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:45:10.927188 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:45:10.938265 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:45:10.949349 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:45:10.960366 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 19:45:11.080619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:11.582042 run create_hlr_db(pid=20541): Launched 19:45:11.707181 bus /sierra_2: Setting Powered False 19:45:12.771827 run create_hlr_db(pid=20541): Terminated: ok {rc=0} 19:45:13.203674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20543): Launched 19:45:13.503843 run osmo-hlr_10.42.42.2(pid=20544): Launched 19:45:13.619912 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:14.142811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20546): Launched 19:45:14.443011 run osmo-stp_10.42.42.5(pid=20547): Launched 19:45:14.559371 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:15.102970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20549): Launched 19:45:15.402523 run osmo-msc_10.42.42.6(pid=20550): Launched 19:45:15.571788 run osmo-stp_10.42.42.5(pid=20547): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20547)] 19:45:15.698303 run osmo-stp_10.42.42.5(pid=20547): stdout: | (launched: 2022-12-12_19:45:14.387214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:15.824849 run osmo-stp_10.42.42.5(pid=20547): stderr: | 20221212194514559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194514559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194514560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194514560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194514560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194514561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194514561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:15.979499 run osmo-stp_10.42.42.5(pid=20547): stdout: | (launched: 2022-12-12_19:45:14.387214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:16.102933 run osmo-stp_10.42.42.5(pid=20547): stderr: | 20221212194514559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194514559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194514560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194514560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194514560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194514561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194514561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:16.248102 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20547): Process ended prematurely: osmo-stp_10.42.42.5(pid=20547) [trial-2381↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20547)] [trial-2381↪ussd:trx-umtrx↪assert_extension.py:17] 19:45:16.257170 tst assert_extension.py:17: Test FAILED (5.9 sec) 19:45:16.284584 run osmo-hlr_10.42.42.2(pid=20544): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20544)] 19:45:16.334361 run osmo-hlr_10.42.42.2(pid=20544): stdout: | (launched: 2022-12-12_19:45:13.448251) 19:45:16.385463 run osmo-hlr_10.42.42.2(pid=20544): stderr: | 20221212194513624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194513624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194513624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194513624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194513624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194513624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194513636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194513646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194513646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194513646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:16.456772 run osmo-msc_10.42.42.6(pid=20550): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20550)] 19:45:16.506527 run osmo-msc_10.42.42.6(pid=20550): stdout: | (launched: 2022-12-12_19:45:15.346930) 19:45:16.558550 run osmo-msc_10.42.42.6(pid=20550): stderr: | 20221212194515617 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194515618 DLGLOBAL DEBUG validating counter group 0x7ff36ba05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194515618 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194515618 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194515618 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194515618 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194515620 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194515620 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194515620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194515620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:16.611730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20543): Terminating (SIGTERM) 19:45:16.654105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20546): Terminating (SIGTERM) 19:45:16.696021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20549): Terminating (SIGTERM) 19:45:16.739298 --- ParallelTerminationStrategy: PID 20543 died... 19:45:16.759197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20543): Terminated: ok {rc=0} 19:45:16.804899 --- ParallelTerminationStrategy: PID 20546 died... 19:45:16.824413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20546): Terminated: ok {rc=0} 19:45:16.869932 --- ParallelTerminationStrategy: PID 20549 died... 19:45:16.889326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20549): Terminated: ok {rc=0} 19:45:16.978136 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:45:18.187348 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:18.193866 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:45:18.225913 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:45:18.252432 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:45:18.303687 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:45:18.336032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:45:18.362602 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:45:18.913940 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:45:18.970121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:18.981917 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:45:19.052535 tst mo_mt_call.py: using LAC 31079 19:45:19.180712 tst mo_mt_call.py: using RAC 224 19:45:19.313597 tst mo_mt_call.py: using CellId 31079 19:45:19.441393 tst mo_mt_call.py: using BVCI 31080 19:45:19.560535 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:19.572254 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:19.583813 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:19.595878 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:19.607944 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:19.619889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:19.737679 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:19.858482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:20.368803 run create_hlr_db(pid=20555): Launched 19:45:20.493341 bus /sierra_2: Setting Powered False 19:45:21.558082 run create_hlr_db(pid=20555): Terminated: ok {rc=0} 19:45:21.999278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Launched 19:45:22.306716 run osmo-hlr_10.42.42.2(pid=20558): Launched 19:45:22.424166 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:22.968888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Launched 19:45:23.275631 run osmo-stp_10.42.42.5(pid=20561): Launched 19:45:23.393398 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:23.947465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20563): Launched 19:45:24.254525 run osmo-msc_10.42.42.6(pid=20564): Launched 19:45:24.428371 run osmo-stp_10.42.42.5(pid=20561): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] 19:45:24.557754 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-12_19:45:23.218935) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:24.686913 run osmo-stp_10.42.42.5(pid=20561): stderr: | 20221212194523390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194523390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194523391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194523391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194523391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194523392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194523392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:24.814670 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-12_19:45:23.218935) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:24.936337 run osmo-stp_10.42.42.5(pid=20561): stderr: | 20221212194523390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194523390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194523391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194523391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194523391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194523392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194523392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:25.081815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:45:25.090937 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:45:25.117831 run osmo-hlr_10.42.42.2(pid=20558): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20558)] 19:45:25.166633 run osmo-hlr_10.42.42.2(pid=20558): stdout: | (launched: 2022-12-12_19:45:22.250333) 19:45:25.216836 run osmo-hlr_10.42.42.2(pid=20558): stderr: | 20221212194522426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194522426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194522426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194522426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194522427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194522427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194522439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194522447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194522447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194522447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:25.286901 run osmo-msc_10.42.42.6(pid=20564): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20564)] 19:45:25.335318 run osmo-msc_10.42.42.6(pid=20564): stdout: | (launched: 2022-12-12_19:45:24.197856) 19:45:25.385399 run osmo-msc_10.42.42.6(pid=20564): stderr: | 20221212194524470 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194524470 DLGLOBAL DEBUG validating counter group 0x7f354142fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194524470 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194524470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194524471 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194524471 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194524472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194524473 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194524473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194524473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:25.435818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminating (SIGTERM) 19:45:25.475817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminating (SIGTERM) 19:45:25.516261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20563): Terminating (SIGTERM) 19:45:25.556807 --- ParallelTerminationStrategy: PID 20557 died... 19:45:25.576269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminated: ok {rc=0} 19:45:25.621093 --- ParallelTerminationStrategy: PID 20560 died... 19:45:25.640033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminated: ok {rc=0} 19:45:25.685197 --- ParallelTerminationStrategy: PID 20563 died... 19:45:25.704108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20563): Terminated: ok {rc=0} 19:45:25.789889 bus /sierra_3: Setting Powered False 19:45:26.890508 bus /sierra_3: Setting Powered False 19:45:28.010215 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:45:29.161604 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:29.174348 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:45:29.245933 tst mo_mt_call_osmux.py: using LAC 31080 19:45:29.375203 tst mo_mt_call_osmux.py: using RAC 225 19:45:29.502594 tst mo_mt_call_osmux.py: using CellId 31080 19:45:29.632187 tst mo_mt_call_osmux.py: using BVCI 31081 19:45:29.750969 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:29.762722 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:29.774284 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:29.786193 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:29.798122 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:29.809940 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:29.929500 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:30.050628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:30.558640 run create_hlr_db(pid=20566): Launched 19:45:30.684270 bus /sierra_2: Setting Powered False 19:45:31.768809 run create_hlr_db(pid=20566): Terminated: ok {rc=0} 19:45:32.302525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20568): Launched 19:45:32.615725 run osmo-hlr_10.42.42.2(pid=20569): Launched 19:45:32.732050 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:33.259623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20571): Launched 19:45:33.566908 run osmo-stp_10.42.42.5(pid=20572): Launched 19:45:33.684349 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:34.239391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20574): Launched 19:45:34.545767 run osmo-msc_10.42.42.6(pid=20575): Launched 19:45:34.716857 run osmo-stp_10.42.42.5(pid=20572): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20572)] 19:45:34.846771 run osmo-stp_10.42.42.5(pid=20572): stdout: | (launched: 2022-12-12_19:45:33.510042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:34.975559 run osmo-stp_10.42.42.5(pid=20572): stderr: | 20221212194533680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194533680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194533681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194533681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194533681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194533682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194533682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:35.102985 run osmo-stp_10.42.42.5(pid=20572): stdout: | (launched: 2022-12-12_19:45:33.510042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:35.224784 run osmo-stp_10.42.42.5(pid=20572): stderr: | 20221212194533680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194533680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194533681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194533681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194533681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194533682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194533682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:35.370457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20572): Process ended prematurely: osmo-stp_10.42.42.5(pid=20572) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20572)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:45:35.379588 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:45:35.406512 run osmo-hlr_10.42.42.2(pid=20569): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20569)] 19:45:35.455018 run osmo-hlr_10.42.42.2(pid=20569): stdout: | (launched: 2022-12-12_19:45:32.559536) 19:45:35.505058 run osmo-hlr_10.42.42.2(pid=20569): stderr: | 20221212194532737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194532737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194532737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194532737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194532737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194532737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194532750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194532759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194532759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194532759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:35.575041 run osmo-msc_10.42.42.6(pid=20575): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20575)] 19:45:35.623138 run osmo-msc_10.42.42.6(pid=20575): stdout: | (launched: 2022-12-12_19:45:34.489343) 19:45:35.672724 run osmo-msc_10.42.42.6(pid=20575): stderr: | 20221212194534762 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194534762 DLGLOBAL DEBUG validating counter group 0x7f7702771c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194534762 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194534762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194534763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194534763 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194534764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194534765 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194534765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194534765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:35.722935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20568): Terminating (SIGTERM) 19:45:35.763028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20571): Terminating (SIGTERM) 19:45:35.803059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20574): Terminating (SIGTERM) 19:45:35.843677 --- ParallelTerminationStrategy: PID 20568 died... 19:45:35.863058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20568): Terminated: ok {rc=0} 19:45:35.907966 --- ParallelTerminationStrategy: PID 20571 died... 19:45:35.926920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20571): Terminated: ok {rc=0} 19:45:35.971064 --- ParallelTerminationStrategy: PID 20574 died... 19:45:35.990056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20574): Terminated: ok {rc=0} 19:45:36.076819 bus /sierra_3: Setting Powered False 19:45:37.178750 bus /sierra_3: Setting Powered False 19:45:38.296025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:45:39.547168 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:39.553669 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:45:39.586396 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:45:39.612836 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:45:39.666106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:45:39.698842 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:45:39.725419 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:45:40.274763 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:45:40.323554 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:40.334852 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:45:40.406651 tst mo_mt_call.py: using LAC 31081 19:45:40.526046 tst mo_mt_call.py: using RAC 226 19:45:40.643622 tst mo_mt_call.py: using CellId 31081 19:45:40.765335 tst mo_mt_call.py: using BVCI 31082 19:45:40.877575 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:40.888673 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:40.899721 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:40.910728 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:40.921787 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:40.932812 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:45:41.052221 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:45:41.171854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:41.681951 run create_hlr_db(pid=20580): Launched 19:45:41.806737 bus /sierra_2: Setting Powered False 19:45:42.872435 run create_hlr_db(pid=20580): Terminated: ok {rc=0} 19:45:43.310794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20582): Launched 19:45:43.619224 run osmo-hlr_10.42.42.2(pid=20583): Launched 19:45:43.737407 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:44.264005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20585): Launched 19:45:44.570681 run osmo-stp_10.42.42.5(pid=20586): Launched 19:45:44.687863 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:45.243321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20588): Launched 19:45:45.549649 run osmo-msc_10.42.42.6(pid=20589): Launched 19:45:45.721629 run osmo-stp_10.42.42.5(pid=20586): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20586)] 19:45:45.904839 run osmo-stp_10.42.42.5(pid=20586): stdout: | (launched: 2022-12-12_19:45:44.514187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:46.079603 run osmo-stp_10.42.42.5(pid=20586): stderr: | 20221212194544683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194544684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194544684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194544684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194544685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194544685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194544685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:46.221444 run osmo-stp_10.42.42.5(pid=20586): stdout: | (launched: 2022-12-12_19:45:44.514187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:46.358403 run osmo-stp_10.42.42.5(pid=20586): stderr: | 20221212194544683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194544684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194544684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194544684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194544685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194544685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194544685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:46.519451 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20586): Process ended prematurely: osmo-stp_10.42.42.5(pid=20586) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20586)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:45:46.530406 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:45:46.563795 run osmo-hlr_10.42.42.2(pid=20583): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20583)] 19:45:46.618578 run osmo-hlr_10.42.42.2(pid=20583): stdout: | (launched: 2022-12-12_19:45:43.562761) 19:45:46.674577 run osmo-hlr_10.42.42.2(pid=20583): stderr: | 20221212194543740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194543740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194543740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194543740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194543740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194543741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194543757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194543768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194543768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194543768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:46.752685 run osmo-msc_10.42.42.6(pid=20589): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20589)] 19:45:46.806973 run osmo-msc_10.42.42.6(pid=20589): stdout: | (launched: 2022-12-12_19:45:45.492785) 19:45:46.863136 run osmo-msc_10.42.42.6(pid=20589): stderr: | 20221212194545767 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194545767 DLGLOBAL DEBUG validating counter group 0x7f1fd2ae4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194545767 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194545767 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194545767 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194545767 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194545769 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194545770 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194545770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194545770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:46.919705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20582): Terminating (SIGTERM) 19:45:46.966853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20585): Terminating (SIGTERM) 19:45:47.014129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20588): Terminating (SIGTERM) 19:45:47.061747 --- ParallelTerminationStrategy: PID 20582 died... 19:45:47.083234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20582): Terminated: ok {rc=0} 19:45:47.137452 --- ParallelTerminationStrategy: PID 20585 died... 19:45:47.158276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20585): Terminated: ok {rc=0} 19:45:47.207966 --- ParallelTerminationStrategy: PID 20588 died... 19:45:47.228243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20588): Terminated: ok {rc=0} 19:45:47.320351 bus /sierra_3: Setting Powered False 19:45:48.422885 bus /sierra_3: Setting Powered False 19:45:49.542018 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:45:50.694055 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:50.706439 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:45:50.779131 tst mo_mt_call_osmux.py: using LAC 31082 19:45:50.908672 tst mo_mt_call_osmux.py: using RAC 227 19:45:51.037292 tst mo_mt_call_osmux.py: using CellId 31082 19:45:51.165321 tst mo_mt_call_osmux.py: using BVCI 31083 19:45:51.285033 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:51.296858 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:51.308539 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:51.320401 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:51.332382 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:45:51.344465 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:45:51.464867 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:45:51.587739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:52.062407 run create_hlr_db(pid=20591): Launched 19:45:52.190168 bus /sierra_2: Setting Powered False 19:45:53.251451 run create_hlr_db(pid=20591): Terminated: ok {rc=0} 19:45:53.701688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20593): Launched 19:45:54.030479 run osmo-hlr_10.42.42.2(pid=20594): Launched 19:45:54.155661 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:54.725256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20596): Launched 19:45:55.055359 run osmo-stp_10.42.42.5(pid=20597): Launched 19:45:55.180682 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:55.776610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20599): Launched 19:45:56.107168 run osmo-msc_10.42.42.6(pid=20600): Launched 19:45:56.291401 run osmo-stp_10.42.42.5(pid=20597): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20597)] 19:45:56.431534 run osmo-stp_10.42.42.5(pid=20597): stdout: | (launched: 2022-12-12_19:45:54.995342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:56.571667 run osmo-stp_10.42.42.5(pid=20597): stderr: | 20221212194555188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194555188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194555189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194555189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194555190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194555190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194555190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:56.709418 run osmo-stp_10.42.42.5(pid=20597): stdout: | (launched: 2022-12-12_19:45:54.995342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:56.840213 run osmo-stp_10.42.42.5(pid=20597): stderr: | 20221212194555188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194555188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194555189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194555189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194555190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194555190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194555190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:56.997168 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20597): Process ended prematurely: osmo-stp_10.42.42.5(pid=20597) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20597)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:45:57.006916 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:45:57.035830 run osmo-hlr_10.42.42.2(pid=20594): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20594)] 19:45:57.087130 run osmo-hlr_10.42.42.2(pid=20594): stdout: | (launched: 2022-12-12_19:45:53.969991) 19:45:57.139979 run osmo-hlr_10.42.42.2(pid=20594): stderr: | 20221212194554170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194554170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194554170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194554170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194554170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194554170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194554182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194554190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194554191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194554191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:57.213845 run osmo-msc_10.42.42.6(pid=20600): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20600)] 19:45:57.265077 run osmo-msc_10.42.42.6(pid=20600): stdout: | (launched: 2022-12-12_19:45:56.046202) 19:45:57.317862 run osmo-msc_10.42.42.6(pid=20600): stderr: | 20221212194556368 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194556369 DLGLOBAL DEBUG validating counter group 0x7f0709ba7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194556369 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194556369 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194556369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194556369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194556371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194556371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194556371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194556371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:57.371073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20593): Terminating (SIGTERM) 19:45:57.413797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20596): Terminating (SIGTERM) 19:45:57.456631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20599): Terminating (SIGTERM) 19:45:57.499638 --- ParallelTerminationStrategy: PID 20593 died... 19:45:57.519874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20593): Terminated: ok {rc=0} 19:45:57.567412 --- ParallelTerminationStrategy: PID 20596 died... 19:45:57.587308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20596): Terminated: ok {rc=0} 19:45:57.634528 --- ParallelTerminationStrategy: PID 20599 died... 19:45:57.654277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20599): Terminated: ok {rc=0} 19:45:57.743240 bus /sierra_3: Setting Powered False 19:45:58.842113 bus /sierra_3: Setting Powered False 19:45:59.959685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:46:01.216469 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:01.227733 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:46:01.268754 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:46:01.302547 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:46:01.367166 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:46:01.415465 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:46:01.461071 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:46:02.006306 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:46:02.080810 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:02.095360 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:46:02.166249 tst mo_mt_call.py: using LAC 31083 19:46:02.307799 tst mo_mt_call.py: using RAC 228 19:46:02.436935 tst mo_mt_call.py: using CellId 31083 19:46:02.565437 tst mo_mt_call.py: using BVCI 31084 19:46:02.678827 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:02.690285 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:02.701545 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:02.712931 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:02.724509 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:02.735954 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:02.856175 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:02.978343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:03.487956 run create_hlr_db(pid=20605): Launched 19:46:03.615961 bus /sierra_2: Setting Powered False 19:46:04.681723 run create_hlr_db(pid=20605): Terminated: ok {rc=0} 19:46:05.122695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20607): Launched 19:46:05.430530 run osmo-hlr_10.42.42.2(pid=20608): Launched 19:46:05.546756 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:06.074080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20610): Launched 19:46:06.381143 run osmo-stp_10.42.42.5(pid=20611): Launched 19:46:06.497247 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:07.053169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20613): Launched 19:46:07.361627 run osmo-msc_10.42.42.6(pid=20614): Launched 19:46:07.534052 run osmo-stp_10.42.42.5(pid=20611): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20611)] 19:46:07.663749 run osmo-stp_10.42.42.5(pid=20611): stdout: | (launched: 2022-12-12_19:46:06.324388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:07.794224 run osmo-stp_10.42.42.5(pid=20611): stderr: | 20221212194606496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194606496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194606497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194606497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194606498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194606498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194606498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:07.922596 run osmo-stp_10.42.42.5(pid=20611): stdout: | (launched: 2022-12-12_19:46:06.324388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:08.044375 run osmo-stp_10.42.42.5(pid=20611): stderr: | 20221212194606496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194606496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194606497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194606497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194606498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194606498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194606498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:08.190354 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20611): Process ended prematurely: osmo-stp_10.42.42.5(pid=20611) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20611)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:46:08.199518 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:46:08.226634 run osmo-hlr_10.42.42.2(pid=20608): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20608)] 19:46:08.275485 run osmo-hlr_10.42.42.2(pid=20608): stdout: | (launched: 2022-12-12_19:46:05.373940) 19:46:08.326004 run osmo-hlr_10.42.42.2(pid=20608): stderr: | 20221212194605551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194605551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194605552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194605552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194605552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194605552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194605564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194605573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194605573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194605573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:08.396313 run osmo-msc_10.42.42.6(pid=20614): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20614)] 19:46:08.444902 run osmo-msc_10.42.42.6(pid=20614): stdout: | (launched: 2022-12-12_19:46:07.304710) 19:46:08.495082 run osmo-msc_10.42.42.6(pid=20614): stderr: | 20221212194607578 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194607578 DLGLOBAL DEBUG validating counter group 0x7f7ef9b89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194607578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194607578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194607579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194607579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194607581 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194607581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194607581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194607581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:08.546355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20607): Terminating (SIGTERM) 19:46:08.587283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20610): Terminating (SIGTERM) 19:46:08.627809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20613): Terminating (SIGTERM) 19:46:08.668456 --- ParallelTerminationStrategy: PID 20607 died... 19:46:08.688047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20607): Terminated: ok {rc=0} 19:46:08.733250 --- ParallelTerminationStrategy: PID 20610 died... 19:46:08.752181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20610): Terminated: ok {rc=0} 19:46:08.797251 --- ParallelTerminationStrategy: PID 20613 died... 19:46:08.816337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20613): Terminated: ok {rc=0} 19:46:08.903945 bus /sierra_3: Setting Powered False 19:46:10.005796 bus /sierra_3: Setting Powered False 19:46:11.122033 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:46:12.273851 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:12.286456 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:46:12.358317 tst mo_mt_call_osmux.py: using LAC 31084 19:46:12.487977 tst mo_mt_call_osmux.py: using RAC 229 19:46:12.617379 tst mo_mt_call_osmux.py: using CellId 31084 19:46:12.747752 tst mo_mt_call_osmux.py: using BVCI 31085 19:46:12.868291 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:12.880129 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:12.891640 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:12.903393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:12.915323 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:12.927111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:13.048262 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:13.168733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:13.679937 run create_hlr_db(pid=20617): Launched 19:46:13.805843 bus /sierra_2: Setting Powered False 19:46:14.870862 run create_hlr_db(pid=20617): Terminated: ok {rc=0} 19:46:15.313454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20619): Launched 19:46:15.620859 run osmo-hlr_10.42.42.2(pid=20620): Launched 19:46:15.738676 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:16.437720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20622): Launched 19:46:16.780709 run osmo-stp_10.42.42.5(pid=20623): Launched 19:46:17.061911 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:17.620588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20625): Launched 19:46:17.927625 run osmo-msc_10.42.42.6(pid=20626): Launched 19:46:18.102777 run osmo-stp_10.42.42.5(pid=20623): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20623)] 19:46:18.233307 run osmo-stp_10.42.42.5(pid=20623): stdout: | (launched: 2022-12-12_19:46:16.718575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:18.362627 run osmo-stp_10.42.42.5(pid=20623): stderr: | 20221212194616948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194616949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194616949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194616949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194616950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194616950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194616950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:18.490389 run osmo-stp_10.42.42.5(pid=20623): stdout: | (launched: 2022-12-12_19:46:16.718575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:18.612292 run osmo-stp_10.42.42.5(pid=20623): stderr: | 20221212194616948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194616949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194616949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194616949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194616950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194616950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194616950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:18.758395 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20623): Process ended prematurely: osmo-stp_10.42.42.5(pid=20623) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20623)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:46:18.767618 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:46:18.794627 run osmo-hlr_10.42.42.2(pid=20620): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20620)] 19:46:18.843117 run osmo-hlr_10.42.42.2(pid=20620): stdout: | (launched: 2022-12-12_19:46:15.564029) 19:46:18.893260 run osmo-hlr_10.42.42.2(pid=20620): stderr: | 20221212194615741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194615741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194615741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194615741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194615741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194615741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194615753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194615762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194615763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194615763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:18.963097 run osmo-msc_10.42.42.6(pid=20626): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20626)] 19:46:19.011319 run osmo-msc_10.42.42.6(pid=20626): stdout: | (launched: 2022-12-12_19:46:17.870940) 19:46:19.061043 run osmo-msc_10.42.42.6(pid=20626): stderr: | 20221212194618144 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194618144 DLGLOBAL DEBUG validating counter group 0x7f91a9ad4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194618144 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194618145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194618145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194618145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194618147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194618147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194618147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194618147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:19.111287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20619): Terminating (SIGTERM) 19:46:19.151882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20622): Terminating (SIGTERM) 19:46:19.192742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20625): Terminating (SIGTERM) 19:46:19.233632 --- ParallelTerminationStrategy: PID 20619 died... 19:46:19.253059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20619): Terminated: ok {rc=0} 19:46:19.298072 --- ParallelTerminationStrategy: PID 20622 died... 19:46:19.317023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20622): Terminated: ok {rc=0} 19:46:19.361943 --- ParallelTerminationStrategy: PID 20625 died... 19:46:19.380984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20625): Terminated: ok {rc=0} 19:46:19.468050 bus /sierra_3: Setting Powered False 19:46:20.568475 bus /sierra_3: Setting Powered False 19:46:21.684816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:46:22.939673 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:22.946954 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:46:22.981501 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:46:23.009179 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:46:23.062696 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:46:23.097568 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:46:23.124834 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:46:23.673140 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:46:23.725573 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:23.737320 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:46:23.807209 tst mo_mt_call.py: using LAC 31085 19:46:23.934296 tst mo_mt_call.py: using RAC 230 19:46:24.061641 tst mo_mt_call.py: using CellId 31085 19:46:24.179980 tst mo_mt_call.py: using BVCI 31086 19:46:24.289195 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:24.300093 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:24.311004 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:24.321939 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:24.332734 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:24.343581 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:46:24.463053 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:46:24.582237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:25.044466 run create_hlr_db(pid=20631): Launched 19:46:25.167247 bus /sierra_2: Setting Powered False 19:46:26.227481 run create_hlr_db(pid=20631): Terminated: ok {rc=0} 19:46:26.664760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20633): Launched 19:46:26.985433 run osmo-hlr_10.42.42.2(pid=20634): Launched 19:46:27.107576 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:27.664327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20636): Launched 19:46:27.985823 run osmo-stp_10.42.42.5(pid=20637): Launched 19:46:28.108189 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:28.691058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20639): Launched 19:46:29.013514 run osmo-msc_10.42.42.6(pid=20640): Launched 19:46:29.193271 run osmo-stp_10.42.42.5(pid=20637): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20637)] 19:46:29.329741 run osmo-stp_10.42.42.5(pid=20637): stdout: | (launched: 2022-12-12_19:46:27.927108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:29.466504 run osmo-stp_10.42.42.5(pid=20637): stderr: | 20221212194628113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194628113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194628114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194628114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194628114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194628115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194628115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:29.601281 run osmo-stp_10.42.42.5(pid=20637): stdout: | (launched: 2022-12-12_19:46:27.927108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:29.729482 run osmo-stp_10.42.42.5(pid=20637): stderr: | 20221212194628113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194628113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194628114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194628114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194628114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194628115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194628115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:29.883144 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20637): Process ended prematurely: osmo-stp_10.42.42.5(pid=20637) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20637)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:46:29.892567 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:46:29.921538 run osmo-hlr_10.42.42.2(pid=20634): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20634)] 19:46:29.973062 run osmo-hlr_10.42.42.2(pid=20634): stdout: | (launched: 2022-12-12_19:46:26.927106) 19:46:30.026032 run osmo-hlr_10.42.42.2(pid=20634): stderr: | 20221212194627119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194627119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194627119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194627119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194627119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194627119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194627132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194627141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194627142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194627142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:30.099591 run osmo-msc_10.42.42.6(pid=20640): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20640)] 19:46:30.150442 run osmo-msc_10.42.42.6(pid=20640): stdout: | (launched: 2022-12-12_19:46:28.954674) 19:46:30.203055 run osmo-msc_10.42.42.6(pid=20640): stderr: | 20221212194629271 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194629271 DLGLOBAL DEBUG validating counter group 0x7f3fc174bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194629271 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194629271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194629271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194629272 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194629273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194629274 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194629274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194629274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:30.256741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20633): Terminating (SIGTERM) 19:46:30.299369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20636): Terminating (SIGTERM) 19:46:30.342194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20639): Terminating (SIGTERM) 19:46:30.385238 --- ParallelTerminationStrategy: PID 20633 died... 19:46:30.405414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20633): Terminated: ok {rc=0} 19:46:30.453340 --- ParallelTerminationStrategy: PID 20636 died... 19:46:30.473223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20636): Terminated: ok {rc=0} 19:46:30.520687 --- ParallelTerminationStrategy: PID 20639 died... 19:46:30.540518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20639): Terminated: ok {rc=0} 19:46:30.631239 bus /sierra_3: Setting Powered False 19:46:31.737841 bus /sierra_3: Setting Powered False 19:46:32.853387 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:46:34.004295 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:34.016675 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:46:34.088527 tst mo_mt_call_osmux.py: using LAC 31086 19:46:34.214488 tst mo_mt_call_osmux.py: using RAC 231 19:46:34.342124 tst mo_mt_call_osmux.py: using CellId 31086 19:46:34.467802 tst mo_mt_call_osmux.py: using BVCI 31087 19:46:34.584817 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:34.596576 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:34.608264 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:34.620601 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:34.632604 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:46:34.644359 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:46:34.764509 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:46:34.880236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:35.344908 run create_hlr_db(pid=20642): Launched 19:46:35.467662 bus /sierra_2: Setting Powered False 19:46:36.527085 run create_hlr_db(pid=20642): Terminated: ok {rc=0} 19:46:36.965639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20644): Launched 19:46:37.288184 run osmo-hlr_10.42.42.2(pid=20645): Launched 19:46:37.410762 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:37.968791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20647): Launched 19:46:38.291863 run osmo-stp_10.42.42.5(pid=20648): Launched 19:46:38.414501 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:38.996484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20650): Launched 19:46:39.318297 run osmo-msc_10.42.42.6(pid=20651): Launched 19:46:39.497909 run osmo-stp_10.42.42.5(pid=20648): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20648)] 19:46:39.634484 run osmo-stp_10.42.42.5(pid=20648): stdout: | (launched: 2022-12-12_19:46:38.232464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:39.771267 run osmo-stp_10.42.42.5(pid=20648): stderr: | 20221212194638421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194638421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194638421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194638422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194638422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194638422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194638422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:39.906223 run osmo-stp_10.42.42.5(pid=20648): stdout: | (launched: 2022-12-12_19:46:38.232464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:40.034685 run osmo-stp_10.42.42.5(pid=20648): stderr: | 20221212194638421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194638421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194638421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194638422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194638422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194638422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194638422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:40.188213 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20648): Process ended prematurely: osmo-stp_10.42.42.5(pid=20648) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20648)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:46:40.198188 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:46:40.227875 run osmo-hlr_10.42.42.2(pid=20645): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20645)] 19:46:40.278863 run osmo-hlr_10.42.42.2(pid=20645): stdout: | (launched: 2022-12-12_19:46:37.229278) 19:46:40.331531 run osmo-hlr_10.42.42.2(pid=20645): stderr: | 20221212194637425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194637425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194637425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194637425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194637425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194637425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194637438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194637446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194637446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194637446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:40.405025 run osmo-msc_10.42.42.6(pid=20651): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20651)] 19:46:40.455955 run osmo-msc_10.42.42.6(pid=20651): stdout: | (launched: 2022-12-12_19:46:39.259190) 19:46:40.508638 run osmo-msc_10.42.42.6(pid=20651): stderr: | 20221212194639578 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194639578 DLGLOBAL DEBUG validating counter group 0x7f2878266c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194639578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194639578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194639578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194639579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194639580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194639581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194639581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194639581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:40.561823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20644): Terminating (SIGTERM) 19:46:40.603781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20647): Terminating (SIGTERM) 19:46:40.646011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20650): Terminating (SIGTERM) 19:46:40.688634 --- ParallelTerminationStrategy: PID 20644 died... 19:46:40.709200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20644): Terminated: ok {rc=0} 19:46:40.756377 --- ParallelTerminationStrategy: PID 20647 died... 19:46:40.775909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20647): Terminated: ok {rc=0} 19:46:40.823037 --- ParallelTerminationStrategy: PID 20650 died... 19:46:40.842844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20650): Terminated: ok {rc=0} 19:46:40.930891 bus /sierra_3: Setting Powered False 19:46:42.030000 bus /sierra_3: Setting Powered False 19:46:43.147075 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:46:44.400770 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:44.407891 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:46:44.442819 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:46:44.470337 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:46:44.524789 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:46:44.559065 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:46:44.586246 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:46:45.136768 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:46:45.189750 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:45.201501 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:46:45.271347 tst mo_mt_call.py: using LAC 31087 19:46:45.398160 tst mo_mt_call.py: using RAC 232 19:46:45.524127 tst mo_mt_call.py: using CellId 31087 19:46:45.643945 tst mo_mt_call.py: using BVCI 31088 19:46:45.754020 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:45.765216 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:45.776168 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:45.787133 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:45.798086 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:45.808930 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:45.939333 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:46.063259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:46.624667 run create_hlr_db(pid=20656): Launched 19:46:46.774799 bus /sierra_2: Setting Powered False 19:46:47.838717 run create_hlr_db(pid=20656): Terminated: ok {rc=0} 19:46:48.269559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20658): Launched 19:46:48.568809 run osmo-hlr_10.42.42.2(pid=20659): Launched 19:46:48.683236 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:49.199586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20661): Launched 19:46:49.499464 run osmo-stp_10.42.42.5(pid=20662): Launched 19:46:49.612819 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:50.154100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20664): Launched 19:46:50.453910 run osmo-msc_10.42.42.6(pid=20665): Launched 19:46:50.621217 run osmo-stp_10.42.42.5(pid=20662): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20662)] 19:46:50.747926 run osmo-stp_10.42.42.5(pid=20662): stdout: | (launched: 2022-12-12_19:46:49.444267) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:50.874089 run osmo-stp_10.42.42.5(pid=20662): stderr: | 20221212194649612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194649612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194649612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194649613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194649613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194649613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194649613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:50.998825 run osmo-stp_10.42.42.5(pid=20662): stdout: | (launched: 2022-12-12_19:46:49.444267) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:51.118243 run osmo-stp_10.42.42.5(pid=20662): stderr: | 20221212194649612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194649612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194649612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194649613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194649613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194649613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194649613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:51.261072 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20662): Process ended prematurely: osmo-stp_10.42.42.5(pid=20662) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20662)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:46:51.269923 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:46:51.296459 run osmo-hlr_10.42.42.2(pid=20659): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20659)] 19:46:51.344718 run osmo-hlr_10.42.42.2(pid=20659): stdout: | (launched: 2022-12-12_19:46:48.513634) 19:46:51.394847 run osmo-hlr_10.42.42.2(pid=20659): stderr: | 20221212194648684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194648684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194648684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194648684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194648684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194648684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194648696 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194648704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194648704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194648704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:51.464420 run osmo-msc_10.42.42.6(pid=20665): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20665)] 19:46:51.512710 run osmo-msc_10.42.42.6(pid=20665): stdout: | (launched: 2022-12-12_19:46:50.398483) 19:46:51.566372 run osmo-msc_10.42.42.6(pid=20665): stderr: | 20221212194650667 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194650668 DLGLOBAL DEBUG validating counter group 0x7f2435d3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194650668 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194650668 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194650668 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194650668 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194650670 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194650670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194650671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194650671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:51.615747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20658): Terminating (SIGTERM) 19:46:51.655401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20661): Terminating (SIGTERM) 19:46:51.694782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20664): Terminating (SIGTERM) 19:46:51.734586 --- ParallelTerminationStrategy: PID 20658 died... 19:46:51.753675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20658): Terminated: ok {rc=0} 19:46:51.797816 --- ParallelTerminationStrategy: PID 20661 died... 19:46:51.816653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20661): Terminated: ok {rc=0} 19:46:51.860625 --- ParallelTerminationStrategy: PID 20664 died... 19:46:51.879273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20664): Terminated: ok {rc=0} 19:46:51.964170 bus /sierra_3: Setting Powered False 19:46:53.065125 bus /sierra_3: Setting Powered False 19:46:54.183122 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:46:55.331592 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:55.343543 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:46:55.412854 tst mo_mt_call_osmux.py: using LAC 31088 19:46:55.532413 tst mo_mt_call_osmux.py: using RAC 233 19:46:55.651056 tst mo_mt_call_osmux.py: using CellId 31088 19:46:55.769591 tst mo_mt_call_osmux.py: using BVCI 31089 19:46:55.876923 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:55.888017 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:55.898852 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:55.909925 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:55.921036 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:55.932033 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:56.045958 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:56.160800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:56.619229 run create_hlr_db(pid=20667): Launched 19:46:56.739934 bus /sierra_2: Setting Powered False 19:46:57.800416 run create_hlr_db(pid=20667): Terminated: ok {rc=0} 19:46:58.236191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20669): Launched 19:46:58.556045 run osmo-hlr_10.42.42.2(pid=20670): Launched 19:46:58.679141 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:59.224850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20672): Launched 19:46:59.544645 run osmo-stp_10.42.42.5(pid=20673): Launched 19:46:59.666554 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:00.245126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20675): Launched 19:47:00.565199 run osmo-msc_10.42.42.6(pid=20676): Launched 19:47:00.743924 run osmo-stp_10.42.42.5(pid=20673): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20673)] 19:47:00.891127 run osmo-stp_10.42.42.5(pid=20673): stdout: | (launched: 2022-12-12_19:46:59.486548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:01.134917 run osmo-stp_10.42.42.5(pid=20673): stderr: | 20221212194659673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194659673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194659673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194659674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194659674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194659674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194659674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:01.274089 run osmo-stp_10.42.42.5(pid=20673): stdout: | (launched: 2022-12-12_19:46:59.486548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:01.405255 run osmo-stp_10.42.42.5(pid=20673): stderr: | 20221212194659673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194659673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194659673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194659674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194659674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194659674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194659674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:01.562325 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20673): Process ended prematurely: osmo-stp_10.42.42.5(pid=20673) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20673)] [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:47:01.572706 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:47:01.604489 run osmo-hlr_10.42.42.2(pid=20670): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20670)] 19:47:01.658386 run osmo-hlr_10.42.42.2(pid=20670): stdout: | (launched: 2022-12-12_19:46:58.497998) 19:47:01.713469 run osmo-hlr_10.42.42.2(pid=20670): stderr: | 20221212194658691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194658691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194658691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194658691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194658691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194658692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194658704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194658713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194658713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194658713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:01.789095 run osmo-msc_10.42.42.6(pid=20676): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20676)] 19:47:01.845983 run osmo-msc_10.42.42.6(pid=20676): stdout: | (launched: 2022-12-12_19:47:00.506550) 19:47:01.901455 run osmo-msc_10.42.42.6(pid=20676): stderr: | 20221212194700823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194700823 DLGLOBAL DEBUG validating counter group 0x7fa750bf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194700823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194700823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194700823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194700824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194700825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194700826 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194700826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194700826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:01.956257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20669): Terminating (SIGTERM) 19:47:02.000636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20672): Terminating (SIGTERM) 19:47:02.046640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20675): Terminating (SIGTERM) 19:47:02.092327 --- ParallelTerminationStrategy: PID 20669 died... 19:47:02.113238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20669): Terminated: ok {rc=0} 19:47:02.163189 --- ParallelTerminationStrategy: PID 20672 died... 19:47:02.183680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20672): Terminated: ok {rc=0} 19:47:02.233675 --- ParallelTerminationStrategy: PID 20675 died... 19:47:02.254261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20675): Terminated: ok {rc=0} 19:47:02.345324 bus /sierra_3: Setting Powered False 19:47:03.444692 bus /sierra_3: Setting Powered False 19:47:04.561422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:47:05.812322 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:47:05.818623 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:47:05.850329 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:47:05.876536 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:47:05.926898 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:47:05.958638 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:47:05.984773 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:47:06.536571 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:47:06.584559 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:06.595599 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:47:06.662656 tst mo_mt_call.py: using LAC 31089 19:47:06.779565 tst mo_mt_call.py: using RAC 234 19:47:06.897932 tst mo_mt_call.py: using CellId 31089 19:47:07.014363 tst mo_mt_call.py: using BVCI 31090 19:47:07.123941 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:07.135022 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:07.146011 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:07.156830 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:07.167736 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:07.178673 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:07.295792 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:07.414769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:07.913685 run create_hlr_db(pid=20681): Launched 19:47:08.038776 bus /sierra_2: Setting Powered False 19:47:09.102623 run create_hlr_db(pid=20681): Terminated: ok {rc=0} 19:47:09.535280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20683): Launched 19:47:09.837678 run osmo-hlr_10.42.42.2(pid=20684): Launched 19:47:09.952598 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:10.514037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20686): Launched 19:47:10.838852 run osmo-stp_10.42.42.5(pid=20687): Launched 19:47:10.962766 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:11.549949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20689): Launched 19:47:11.876022 run osmo-msc_10.42.42.6(pid=20690): Launched 19:47:12.057873 run osmo-stp_10.42.42.5(pid=20687): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20687)] 19:47:12.195531 run osmo-stp_10.42.42.5(pid=20687): stdout: | (launched: 2022-12-12_19:47:10.779915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:12.333993 run osmo-stp_10.42.42.5(pid=20687): stderr: | 20221212194710967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194710967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194710967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194710968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194710968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194710968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194710968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:12.470284 run osmo-stp_10.42.42.5(pid=20687): stdout: | (launched: 2022-12-12_19:47:10.779915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:12.600217 run osmo-stp_10.42.42.5(pid=20687): stderr: | 20221212194710967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194710967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194710967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194710968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194710968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194710968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194710968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:12.755839 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20687): Process ended prematurely: osmo-stp_10.42.42.5(pid=20687) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20687)] [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:47:12.765587 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:47:12.794731 run osmo-hlr_10.42.42.2(pid=20684): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20684)] 19:47:12.845980 run osmo-hlr_10.42.42.2(pid=20684): stdout: | (launched: 2022-12-12_19:47:09.782326) 19:47:12.898936 run osmo-hlr_10.42.42.2(pid=20684): stderr: | 20221212194709956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194709956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194709956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194709956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194709956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194709956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194709967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194709975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194709975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194709976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:12.972522 run osmo-msc_10.42.42.6(pid=20690): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20690)] 19:47:13.023448 run osmo-msc_10.42.42.6(pid=20690): stdout: | (launched: 2022-12-12_19:47:11.816591) 19:47:13.076196 run osmo-msc_10.42.42.6(pid=20690): stderr: | 20221212194712133 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194712133 DLGLOBAL DEBUG validating counter group 0x7f6ec01e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194712134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194712134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194712134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194712134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194712136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194712136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194712137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194712137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:13.129491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20683): Terminating (SIGTERM) 19:47:13.172219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20686): Terminating (SIGTERM) 19:47:13.214976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20689): Terminating (SIGTERM) 19:47:13.258316 --- ParallelTerminationStrategy: PID 20683 died... 19:47:13.278746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20683): Terminated: ok {rc=0} 19:47:13.326659 --- ParallelTerminationStrategy: PID 20686 died... 19:47:13.346511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20686): Terminated: ok {rc=0} 19:47:13.394114 --- ParallelTerminationStrategy: PID 20689 died... 19:47:13.414041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20689): Terminated: ok {rc=0} 19:47:13.503727 bus /sierra_3: Setting Powered False 19:47:14.603302 bus /sierra_3: Setting Powered False 19:47:15.719904 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:47:16.866341 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:16.879260 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:47:16.950130 tst mo_mt_call_osmux.py: using LAC 31090 19:47:17.114659 tst mo_mt_call_osmux.py: using RAC 235 19:47:17.263686 tst mo_mt_call_osmux.py: using CellId 31090 19:47:17.391611 tst mo_mt_call_osmux.py: using BVCI 31091 19:47:17.502888 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:17.514258 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:17.525401 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:17.536439 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:17.551188 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:17.563592 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:17.681353 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:17.802673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:18.309182 run create_hlr_db(pid=20692): Launched 19:47:18.434089 bus /sierra_2: Setting Powered False 19:47:19.498486 run create_hlr_db(pid=20692): Terminated: ok {rc=0} 19:47:19.931229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20694): Launched 19:47:20.232643 run osmo-hlr_10.42.42.2(pid=20695): Launched 19:47:20.348360 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:20.866648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20697): Launched 19:47:21.167258 run osmo-stp_10.42.42.5(pid=20698): Launched 19:47:21.280858 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:21.824470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20700): Launched 19:47:22.125573 run osmo-msc_10.42.42.6(pid=20701): Launched 19:47:22.294526 run osmo-stp_10.42.42.5(pid=20698): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20698)] 19:47:22.422208 run osmo-stp_10.42.42.5(pid=20698): stdout: | (launched: 2022-12-12_19:47:21.112262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:22.549257 run osmo-stp_10.42.42.5(pid=20698): stderr: | 20221212194721278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194721278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194721278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194721279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194721279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194721279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194721279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:22.674780 run osmo-stp_10.42.42.5(pid=20698): stdout: | (launched: 2022-12-12_19:47:21.112262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:22.794282 run osmo-stp_10.42.42.5(pid=20698): stderr: | 20221212194721278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194721278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194721278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194721279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194721279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194721279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194721279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:22.938009 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20698): Process ended prematurely: osmo-stp_10.42.42.5(pid=20698) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20698)] [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:47:22.946770 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:47:22.973056 run osmo-hlr_10.42.42.2(pid=20695): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20695)] 19:47:23.020353 run osmo-hlr_10.42.42.2(pid=20695): stdout: | (launched: 2022-12-12_19:47:20.177289) 19:47:23.070107 run osmo-hlr_10.42.42.2(pid=20695): stderr: | 20221212194720350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194720350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194720350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194720351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194720351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194720351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194720364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194720375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194720376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194720376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:23.138819 run osmo-msc_10.42.42.6(pid=20701): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20701)] 19:47:23.186044 run osmo-msc_10.42.42.6(pid=20701): stdout: | (launched: 2022-12-12_19:47:22.070133) 19:47:23.234912 run osmo-msc_10.42.42.6(pid=20701): stderr: | 20221212194722341 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194722341 DLGLOBAL DEBUG validating counter group 0x7fd284e84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194722341 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194722341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194722341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194722342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194722343 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194722344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194722344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194722344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:23.283982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20694): Terminating (SIGTERM) 19:47:23.323391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20697): Terminating (SIGTERM) 19:47:23.363227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20700): Terminating (SIGTERM) 19:47:23.403469 --- ParallelTerminationStrategy: PID 20694 died... 19:47:23.422735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20694): Terminated: ok {rc=0} 19:47:23.466959 --- ParallelTerminationStrategy: PID 20697 died... 19:47:23.486049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20697): Terminated: ok {rc=0} 19:47:23.530786 --- ParallelTerminationStrategy: PID 20700 died... 19:47:23.549554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20700): Terminated: ok {rc=0} 19:47:23.636348 bus /sierra_3: Setting Powered False 19:47:24.737816 bus /sierra_3: Setting Powered False 19:47:25.855415 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:47:27.106716 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:47:27.112207 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:47:27.144583 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:47:27.171125 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:47:27.223251 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:47:27.255511 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:47:27.281845 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:47:27.829802 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:47:27.877937 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:27.888841 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:47:27.957824 tst mo_mt_call.py: using LAC 31091 19:47:28.076740 tst mo_mt_call.py: using RAC 236 19:47:28.195871 tst mo_mt_call.py: using CellId 31091 19:47:28.313752 tst mo_mt_call.py: using BVCI 31092 19:47:28.423716 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:28.434613 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:28.445340 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:28.456260 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:28.466960 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:28.477699 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:47:28.594880 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:47:28.713163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:29.214207 run create_hlr_db(pid=20707): Launched 19:47:29.339050 bus /sierra_2: Setting Powered False 19:47:30.404342 run create_hlr_db(pid=20707): Terminated: ok {rc=0} 19:47:30.851595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20709): Launched 19:47:31.221732 run osmo-hlr_10.42.42.2(pid=20710): Launched 19:47:31.465624 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:32.161687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20712): Launched 19:47:32.494957 run osmo-stp_10.42.42.5(pid=20713): Launched 19:47:32.620884 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:33.209302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20715): Launched 19:47:33.535402 run osmo-msc_10.42.42.6(pid=20716): Launched 19:47:33.719938 run osmo-stp_10.42.42.5(pid=20713): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20713)] 19:47:33.857798 run osmo-stp_10.42.42.5(pid=20713): stdout: | (launched: 2022-12-12_19:47:32.435891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:33.996562 run osmo-stp_10.42.42.5(pid=20713): stderr: | 20221212194732623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194732624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194732624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194732624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194732625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194732625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194732625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:34.131636 run osmo-stp_10.42.42.5(pid=20713): stdout: | (launched: 2022-12-12_19:47:32.435891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:34.261100 run osmo-stp_10.42.42.5(pid=20713): stderr: | 20221212194732623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194732624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194732624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194732624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194732625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194732625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194732625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:34.415873 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20713): Process ended prematurely: osmo-stp_10.42.42.5(pid=20713) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20713)] [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:47:34.425508 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 19:47:34.454231 run osmo-hlr_10.42.42.2(pid=20710): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20710)] 19:47:34.505459 run osmo-hlr_10.42.42.2(pid=20710): stdout: | (launched: 2022-12-12_19:47:31.155348) 19:47:34.558490 run osmo-hlr_10.42.42.2(pid=20710): stderr: | 20221212194731487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194731487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194731487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194731487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194731487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194731487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194731503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194731512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194731512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194731512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:34.632468 run osmo-msc_10.42.42.6(pid=20716): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20716)] 19:47:34.683708 run osmo-msc_10.42.42.6(pid=20716): stdout: | (launched: 2022-12-12_19:47:33.476231) 19:47:34.736479 run osmo-msc_10.42.42.6(pid=20716): stderr: | 20221212194733794 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194733794 DLGLOBAL DEBUG validating counter group 0x7eff45aa2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194733794 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194733794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194733794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194733795 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194733796 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194733797 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194733797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194733797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:34.789886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20709): Terminating (SIGTERM) 19:47:34.833034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20712): Terminating (SIGTERM) 19:47:34.875684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20715): Terminating (SIGTERM) 19:47:34.918417 --- ParallelTerminationStrategy: PID 20709 died... 19:47:34.938692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20709): Terminated: ok {rc=0} 19:47:34.986066 --- ParallelTerminationStrategy: PID 20712 died... 19:47:35.005890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20712): Terminated: ok {rc=0} 19:47:35.053097 --- ParallelTerminationStrategy: PID 20715 died... 19:47:35.072924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20715): Terminated: ok {rc=0} 19:47:35.163444 bus /sierra_3: Setting Powered False 19:47:36.262285 bus /sierra_3: Setting Powered False 19:47:37.378339 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:47:38.530356 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:38.542652 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:47:38.614663 tst mo_mt_call_osmux.py: using LAC 31092 19:47:38.740765 tst mo_mt_call_osmux.py: using RAC 237 19:47:38.867470 tst mo_mt_call_osmux.py: using CellId 31092 19:47:38.986610 tst mo_mt_call_osmux.py: using BVCI 31093 19:47:39.097233 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:39.108264 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:39.119346 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:39.130266 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:39.141124 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:47:39.151796 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:47:39.271106 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:47:39.387170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:39.855162 run create_hlr_db(pid=20718): Launched 19:47:39.980527 bus /sierra_2: Setting Powered False 19:47:41.041501 run create_hlr_db(pid=20718): Terminated: ok {rc=0} 19:47:41.483436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20720): Launched 19:47:41.809325 run osmo-hlr_10.42.42.2(pid=20721): Launched 19:47:41.935061 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:42.490191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20723): Launched 19:47:42.815926 run osmo-stp_10.42.42.5(pid=20724): Launched 19:47:42.939506 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:43.532053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20726): Launched 19:47:43.857978 run osmo-msc_10.42.42.6(pid=20727): Launched 19:47:44.040534 run osmo-stp_10.42.42.5(pid=20724): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20724)] 19:47:44.177636 run osmo-stp_10.42.42.5(pid=20724): stdout: | (launched: 2022-12-12_19:47:42.756816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:44.315955 run osmo-stp_10.42.42.5(pid=20724): stderr: | 20221212194742944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194742945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194742945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194742945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194742946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194742946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194742946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:44.451597 run osmo-stp_10.42.42.5(pid=20724): stdout: | (launched: 2022-12-12_19:47:42.756816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:44.580807 run osmo-stp_10.42.42.5(pid=20724): stderr: | 20221212194742944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194742945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194742945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194742945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194742946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194742946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194742946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:44.735881 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20724): Process ended prematurely: osmo-stp_10.42.42.5(pid=20724) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20724)] [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:47:44.745829 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:47:44.774594 run osmo-hlr_10.42.42.2(pid=20721): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20721)] 19:47:44.825647 run osmo-hlr_10.42.42.2(pid=20721): stdout: | (launched: 2022-12-12_19:47:41.750273) 19:47:44.878596 run osmo-hlr_10.42.42.2(pid=20721): stderr: | 20221212194741945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194741945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194741945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194741945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194741945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194741945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194741957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194741966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194741966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194741966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:44.952064 run osmo-msc_10.42.42.6(pid=20727): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20727)] 19:47:45.003112 run osmo-msc_10.42.42.6(pid=20727): stdout: | (launched: 2022-12-12_19:47:43.798705) 19:47:45.055911 run osmo-msc_10.42.42.6(pid=20727): stderr: | 20221212194744118 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194744118 DLGLOBAL DEBUG validating counter group 0x7f50d9268c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194744118 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194744118 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194744118 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194744119 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194744120 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194744121 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194744121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194744121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:45.109414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20720): Terminating (SIGTERM) 19:47:45.151345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20723): Terminating (SIGTERM) 19:47:45.193683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20726): Terminating (SIGTERM) 19:47:45.236565 --- ParallelTerminationStrategy: PID 20720 died... 19:47:45.257084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20720): Terminated: ok {rc=0} 19:47:45.304413 --- ParallelTerminationStrategy: PID 20723 died... 19:47:45.324286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20723): Terminated: ok {rc=0} 19:47:45.371261 --- ParallelTerminationStrategy: PID 20726 died... 19:47:45.391065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20726): Terminated: ok {rc=0} 19:47:45.480114 bus /sierra_3: Setting Powered False 19:47:46.586243 bus /sierra_3: Setting Powered False 19:47:47.709319 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:47:48.957501 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:47:48.963450 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:47:48.995736 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 19:47:49.022269 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 19:47:49.078273 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:47:49.111300 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 19:47:49.137734 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 19:47:49.683440 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 19:47:49.731942 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:49.743538 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:47:49.794034 tst mo_mt_call.py: using LAC 31093 19:47:49.911451 tst mo_mt_call.py: using RAC 238 19:47:50.034405 tst mo_mt_call.py: using CellId 31093 19:47:50.152757 tst mo_mt_call.py: using BVCI 31094 19:47:50.262097 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:50.273607 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:50.284851 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:50.296126 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:50.307265 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:50.318486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:47:50.437729 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:47:50.553349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:51.022042 run create_hlr_db(pid=20732): Launched 19:47:51.147154 bus /sierra_2: Setting Powered False 19:47:52.207254 run create_hlr_db(pid=20732): Terminated: ok {rc=0} 19:47:52.627520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Launched 19:47:52.929166 run osmo-hlr_10.42.42.2(pid=20735): Launched 19:47:53.043480 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:53.578376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Launched 19:47:53.880857 run osmo-stp_10.42.42.5(pid=20738): Launched 19:47:53.998341 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:54.545297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20740): Launched 19:47:54.847733 run osmo-msc_10.42.42.6(pid=20741): Launched 19:47:55.016821 run osmo-stp_10.42.42.5(pid=20738): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] 19:47:55.144455 run osmo-stp_10.42.42.5(pid=20738): stdout: | (launched: 2022-12-12_19:47:53.825274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:55.271854 run osmo-stp_10.42.42.5(pid=20738): stderr: | 20221212194753992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194753993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194753993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194753993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194753994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194753994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194753994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:55.397883 run osmo-stp_10.42.42.5(pid=20738): stdout: | (launched: 2022-12-12_19:47:53.825274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:55.517581 run osmo-stp_10.42.42.5(pid=20738): stderr: | 20221212194753992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194753993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194753993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194753993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194753994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194753994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194753994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:55.661179 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20738): Process ended prematurely: osmo-stp_10.42.42.5(pid=20738) [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 19:47:55.670281 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:47:55.697201 run osmo-hlr_10.42.42.2(pid=20735): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20735)] 19:47:55.745523 run osmo-hlr_10.42.42.2(pid=20735): stdout: | (launched: 2022-12-12_19:47:52.873789) 19:47:55.795166 run osmo-hlr_10.42.42.2(pid=20735): stderr: | 20221212194753046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194753046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194753046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194753046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194753046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194753047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194753059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194753068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194753068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194753068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:55.865275 run osmo-msc_10.42.42.6(pid=20741): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20741)] 19:47:55.913765 run osmo-msc_10.42.42.6(pid=20741): stdout: | (launched: 2022-12-12_19:47:54.792120) 19:47:55.963465 run osmo-msc_10.42.42.6(pid=20741): stderr: | 20221212194755062 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194755062 DLGLOBAL DEBUG validating counter group 0x7f5d6ecefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194755062 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194755062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194755062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194755063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194755064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194755065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194755065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194755065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:56.013472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Terminating (SIGTERM) 19:47:56.053460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Terminating (SIGTERM) 19:47:56.093446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20740): Terminating (SIGTERM) 19:47:56.133740 --- ParallelTerminationStrategy: PID 20734 died... 19:47:56.153155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Terminated: ok {rc=0} 19:47:56.197778 --- ParallelTerminationStrategy: PID 20737 died... 19:47:56.216494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Terminated: ok {rc=0} 19:47:56.260723 --- ParallelTerminationStrategy: PID 20740 died... 19:47:56.279708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20740): Terminated: ok {rc=0} 19:47:56.366935 bus /sierra_3: Setting Powered False 19:47:57.466306 bus /sierra_3: Setting Powered False 19:47:58.582237 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 19:47:59.727475 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:59.739810 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:47:59.791966 tst mo_mt_call_osmux.py: using LAC 31094 19:47:59.912295 tst mo_mt_call_osmux.py: using RAC 239 19:48:00.032873 tst mo_mt_call_osmux.py: using CellId 31094 19:48:00.152562 tst mo_mt_call_osmux.py: using BVCI 31095 19:48:00.261343 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:48:00.272533 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:48:00.283616 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:48:00.294697 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:48:00.305912 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:48:00.316986 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:48:00.438111 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:48:00.554559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:01.097301 run create_hlr_db(pid=20743): Launched 19:48:01.254784 bus /sierra_2: Setting Powered False 19:48:02.315493 run create_hlr_db(pid=20743): Terminated: ok {rc=0} 19:48:02.806879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20745): Launched 19:48:03.133748 run osmo-hlr_10.42.42.2(pid=20746): Launched 19:48:03.258009 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:03.821532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20748): Launched 19:48:04.147517 run osmo-stp_10.42.42.5(pid=20749): Launched 19:48:04.274215 run osmo-msc_10.42.42.6: Starting osmo-msc 19:48:04.861937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20751): Launched 19:48:05.188413 run osmo-msc_10.42.42.6(pid=20752): Launched 19:48:05.371278 run osmo-stp_10.42.42.5(pid=20749): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20749)] 19:48:05.508608 run osmo-stp_10.42.42.5(pid=20749): stdout: | (launched: 2022-12-12_19:48:04.088388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:05.647404 run osmo-stp_10.42.42.5(pid=20749): stderr: | 20221212194804275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194804275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194804275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194804276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194804276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194804276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194804276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:05.783865 run osmo-stp_10.42.42.5(pid=20749): stdout: | (launched: 2022-12-12_19:48:04.088388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:05.913038 run osmo-stp_10.42.42.5(pid=20749): stderr: | 20221212194804275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194804275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194804275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194804276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194804276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194804276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194804276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:06.068638 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20749): Process ended prematurely: osmo-stp_10.42.42.5(pid=20749) [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20749)] [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 19:48:06.078385 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:48:06.106819 run osmo-hlr_10.42.42.2(pid=20746): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20746)] 19:48:06.158546 run osmo-hlr_10.42.42.2(pid=20746): stdout: | (launched: 2022-12-12_19:48:03.074681) 19:48:06.211288 run osmo-hlr_10.42.42.2(pid=20746): stderr: | 20221212194803273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194803273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194803273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194803273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194803273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194803273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194803283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194803295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194803295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194803295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:06.285173 run osmo-msc_10.42.42.6(pid=20752): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20752)] 19:48:06.336208 run osmo-msc_10.42.42.6(pid=20752): stdout: | (launched: 2022-12-12_19:48:05.129211) 19:48:06.389118 run osmo-msc_10.42.42.6(pid=20752): stderr: | 20221212194805448 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194805448 DLGLOBAL DEBUG validating counter group 0x7f61eae42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194805449 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194805449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194805449 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194805449 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194805451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194805451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194805451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194805451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:48:06.442066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20745): Terminating (SIGTERM) 19:48:06.484483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20748): Terminating (SIGTERM) 19:48:06.527111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20751): Terminating (SIGTERM) 19:48:06.569784 --- ParallelTerminationStrategy: PID 20745 died... 19:48:06.590086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20745): Terminated: ok {rc=0} 19:48:06.636925 --- ParallelTerminationStrategy: PID 20748 died... 19:48:06.657006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20748): Terminated: ok {rc=0} 19:48:06.703981 --- ParallelTerminationStrategy: PID 20751 died... 19:48:06.723787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20751): Terminated: ok {rc=0} 19:48:06.812689 bus /sierra_3: Setting Powered False 19:48:07.911930 bus /sierra_3: Setting Powered False 19:48:09.030326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:trx-umtrx --------------------------------------------------------------------- 19:48:10.280168 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:48:10.285906 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:48:10.321407 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:48:10.349121 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 19:48:10.436127 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:48:10.468784 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:48:10.495492 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 19:48:11.082045 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 19:48:11.087746 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:11.098999 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 19:48:11.151888 tst emergency_mo_mt_call.py: using LAC 31095 19:48:11.276709 tst emergency_mo_mt_call.py: using RAC 240 19:48:11.401823 tst emergency_mo_mt_call.py: using CellId 31095 19:48:11.529952 tst emergency_mo_mt_call.py: using BVCI 31096 19:48:11.646992 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:11.658274 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:11.669312 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:11.680509 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:11.691464 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:11.702904 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:11.819006 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:11.938918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:12.435642 run create_hlr_db(pid=20757): Launched 19:48:12.558370 bus /sierra_2: Setting Powered False 19:48:13.622404 run create_hlr_db(pid=20757): Terminated: ok {rc=0} 19:48:14.050764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20759): Launched 19:48:14.350222 run osmo-hlr_10.42.42.2(pid=20760): Launched 19:48:14.464668 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:14.977738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20762): Launched 19:48:15.274317 run osmo-stp_10.42.42.5(pid=20763): Launched 19:48:15.403084 tst emergency_mo_mt_call.py: using MSISDN 7938 19:48:15.566637 run osmo-msc_10.42.42.6: Starting osmo-msc 19:48:16.118555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20765): Launched 19:48:16.480486 run osmo-msc_10.42.42.6(pid=20766): Launched 19:48:16.850921 run osmo-stp_10.42.42.5(pid=20763): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20763)] 19:48:17.124005 run osmo-stp_10.42.42.5(pid=20763): stdout: | (launched: 2022-12-12_19:48:15.219748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:17.303810 run osmo-stp_10.42.42.5(pid=20763): stderr: | 20221212194815386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194815386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194815386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194815386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194815387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194815387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194815387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:17.438076 run osmo-stp_10.42.42.5(pid=20763): stdout: | (launched: 2022-12-12_19:48:15.219748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:17.566523 run osmo-stp_10.42.42.5(pid=20763): stderr: | 20221212194815386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194815386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194815386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194815386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194815387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194815387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194815387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:17.719799 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20763): Process ended prematurely: osmo-stp_10.42.42.5(pid=20763) [trial-2381↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20763)] [trial-2381↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 19:48:17.728821 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 19:48:17.757075 run osmo-hlr_10.42.42.2(pid=20760): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20760)] 19:48:17.808473 run osmo-hlr_10.42.42.2(pid=20760): stdout: | (launched: 2022-12-12_19:48:14.296045) 19:48:17.861469 run osmo-hlr_10.42.42.2(pid=20760): stderr: | 20221212194814466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194814466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194814466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194814466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194814466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194814466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194814478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194814487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194814487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194814487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:17.935415 run osmo-msc_10.42.42.6(pid=20766): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20766)] 19:48:17.986903 run osmo-msc_10.42.42.6(pid=20766): stdout: | (launched: 2022-12-12_19:48:16.419232) 19:48:18.039976 run osmo-msc_10.42.42.6(pid=20766): stderr: | 20221212194816926 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194816926 DLGLOBAL DEBUG validating counter group 0x7f9642692c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194816926 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194816926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194816926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194816927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194816928 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194816929 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194816929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194816929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:48:18.093848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20759): Terminating (SIGTERM) 19:48:18.136550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20762): Terminating (SIGTERM) 19:48:18.179285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20765): Terminating (SIGTERM) 19:48:18.222242 --- ParallelTerminationStrategy: PID 20759 died... 19:48:18.242718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20759): Terminated: ok {rc=0} 19:48:18.290795 --- ParallelTerminationStrategy: PID 20762 died... 19:48:18.310874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20762): Terminated: ok {rc=0} 19:48:18.358337 --- ParallelTerminationStrategy: PID 20765 died... 19:48:18.378271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20765): Terminated: ok {rc=0} 19:48:18.467773 bus /sierra_3: Setting Powered False 19:48:19.568445 bus /sierra_3: Setting Powered False 19:48:20.686237 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 19:48:21.775177 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:21.787175 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 19:48:21.840086 tst emergency_preemptive_call.py: using LAC 31096 19:48:21.964387 tst emergency_preemptive_call.py: using RAC 241 19:48:22.090525 tst emergency_preemptive_call.py: using CellId 31096 19:48:22.208302 tst emergency_preemptive_call.py: using BVCI 31097 19:48:22.316560 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:22.327565 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:22.338452 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:22.349307 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:22.359807 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:48:22.370348 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:22.488543 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:22.611128 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:22.728414 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:22.845219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:23.343781 run create_hlr_db(pid=20768): Launched 19:48:23.466176 bus /sierra_2: Setting Powered False 19:48:24.530023 run create_hlr_db(pid=20768): Terminated: ok {rc=0} 19:48:24.958835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20770): Launched 19:48:25.257856 run osmo-hlr_10.42.42.2(pid=20771): Launched 19:48:25.373088 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:25.898095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20773): Launched 19:48:26.198446 run osmo-stp_10.42.42.5(pid=20774): Launched 19:48:26.327569 tst emergency_preemptive_call.py: using MSISDN 7939 19:48:26.477900 run osmo-msc_10.42.42.6: Starting osmo-msc 19:48:27.012025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20776): Launched 19:48:27.308647 run osmo-msc_10.42.42.6(pid=20777): Launched 19:48:27.475145 run osmo-stp_10.42.42.5(pid=20774): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20774)] 19:48:27.602893 run osmo-stp_10.42.42.5(pid=20774): stdout: | (launched: 2022-12-12_19:48:26.143389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:27.728862 run osmo-stp_10.42.42.5(pid=20774): stderr: | 20221212194826310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194826310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194826310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194826311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194826311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194826311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194826311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:27.853205 run osmo-stp_10.42.42.5(pid=20774): stdout: | (launched: 2022-12-12_19:48:26.143389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:27.971861 run osmo-stp_10.42.42.5(pid=20774): stderr: | 20221212194826310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194826310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194826310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194826311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194826311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194826311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194826311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:28.113602 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20774): Process ended prematurely: osmo-stp_10.42.42.5(pid=20774) [trial-2381↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20774)] [trial-2381↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 19:48:28.122076 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 19:48:28.148940 run osmo-hlr_10.42.42.2(pid=20771): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20771)] 19:48:28.197719 run osmo-hlr_10.42.42.2(pid=20771): stdout: | (launched: 2022-12-12_19:48:25.202981) 19:48:28.247945 run osmo-hlr_10.42.42.2(pid=20771): stderr: | 20221212194825374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194825374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194825374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194825374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194825374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194825374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194825386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194825394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194825395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194825395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:28.318407 run osmo-msc_10.42.42.6(pid=20777): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20777)] 19:48:28.366596 run osmo-msc_10.42.42.6(pid=20777): stdout: | (launched: 2022-12-12_19:48:27.254272) 19:48:28.416353 run osmo-msc_10.42.42.6(pid=20777): stderr: | 20221212194827521 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212194827521 DLGLOBAL DEBUG validating counter group 0x7fa52aee0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212194827521 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212194827521 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212194827522 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212194827522 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212194827524 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212194827524 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212194827524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212194827524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:48:28.466316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20770): Terminating (SIGTERM) 19:48:28.506316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20773): Terminating (SIGTERM) 19:48:28.546215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20776): Terminating (SIGTERM) 19:48:28.586278 --- ParallelTerminationStrategy: PID 20770 died... 19:48:28.605694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20770): Terminated: ok {rc=0} 19:48:28.650299 --- ParallelTerminationStrategy: PID 20773 died... 19:48:28.669169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20773): Terminated: ok {rc=0} 19:48:28.713280 --- ParallelTerminationStrategy: PID 20776 died... 19:48:28.732035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20776): Terminated: ok {rc=0} 19:48:28.815542 bus /sierra_9: Setting Powered False 19:48:29.910613 bus /sierra_9: Setting Powered False 19:48:31.035651 bus /sierra_8: Setting Powered False 19:48:32.140916 bus /sierra_8: Setting Powered False 19:48:33.260653 bus /sierra_3: Setting Powered False 19:48:34.359296 bus /sierra_3: Setting Powered False 19:48:35.477054 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx --------------------------------------------------------------------- 19:48:36.747660 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:48:36.752069 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:48:36.784504 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 19:48:36.822953 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 19:48:36.909398 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:48:36.941512 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 19:48:36.979665 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 19:48:37.568817 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 19:48:37.618336 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:37.629017 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:48:37.677363 tst cs_paging_gprs_active.py: using LAC 31097 19:48:37.796029 tst cs_paging_gprs_active.py: using RAC 242 19:48:37.916576 tst cs_paging_gprs_active.py: using CellId 31097 19:48:38.036023 tst cs_paging_gprs_active.py: using BVCI 31098 19:48:38.146803 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.157503 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.167872 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.178414 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.188700 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.199104 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.209655 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.220240 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:38.231006 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:38.350943 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:38.465434 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:48:38.669238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:38.973176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20783): Launched 19:48:39.237860 run iperf3-srv_10.42.42.10(pid=20784): Launched 19:48:39.351425 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:48:39.553358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:39.856477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20785): Launched 19:48:40.120710 run iperf3-srv_10.42.42.10(pid=20786): Launched 19:48:40.234889 tst cs_paging_gprs_active.py:38: start network... 19:48:40.437047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:40.905548 run create_hlr_db(pid=20787): Launched 19:48:41.030639 bus /sierra_2: Setting Powered False 19:48:42.091762 run create_hlr_db(pid=20787): Terminated: ok {rc=0} 19:48:42.537443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20789): Launched 19:48:42.864209 run osmo-hlr_10.42.42.2(pid=20790): Launched 19:48:42.989506 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:43.549722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20792): Launched 19:48:43.875486 run osmo-stp_10.42.42.5(pid=20793): Launched 19:48:44.001681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:44.563138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20795): Launched 19:48:44.687874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:44.963362 run patchelf(pid=20796): Launched 19:48:45.144890 run osmo-stp_10.42.42.5(pid=20793): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20793)] 19:48:45.284035 run osmo-stp_10.42.42.5(pid=20793): stdout: | (launched: 2022-12-12_19:48:43.816116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:45.424297 run osmo-stp_10.42.42.5(pid=20793): stderr: | 20221212194844005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194844005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194844005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194844006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194844006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194844006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194844006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:45.564334 run osmo-stp_10.42.42.5(pid=20793): stdout: | (launched: 2022-12-12_19:48:43.816116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:45.698120 run osmo-stp_10.42.42.5(pid=20793): stderr: | 20221212194844005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194844005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194844005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194844006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194844006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194844006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194844006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:45.870454 run patchelf(pid=20796): Terminating (SIGINT) 19:48:46.071409 run patchelf(pid=20796): Terminated: ok {rc=0} 19:48:46.207162 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20793): Process ended prematurely: osmo-stp_10.42.42.5(pid=20793) [trial-2381↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20793)] [trial-2381↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 19:48:46.218509 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:48:46.251231 run osmo-hlr_10.42.42.2(pid=20790): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20790)] 19:48:46.305137 run osmo-hlr_10.42.42.2(pid=20790): stdout: | (launched: 2022-12-12_19:48:42.805271) 19:48:46.360336 run osmo-hlr_10.42.42.2(pid=20790): stderr: | 20221212194843001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194843001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194843001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194843001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194843001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194843001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194843014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194843022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194843022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194843022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:46.416053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20783): Terminating (SIGTERM) 19:48:46.461560 run iperf3-srv_10.42.42.10(pid=20784): Terminating (SIGTERM) 19:48:46.509523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20785): Terminating (SIGTERM) 19:48:46.555190 run iperf3-srv_10.42.42.10(pid=20786): Terminating (SIGTERM) 19:48:46.602872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20789): Terminating (SIGTERM) 19:48:46.648464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20792): Terminating (SIGTERM) 19:48:46.693613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20795): Terminating (SIGTERM) 19:48:46.738824 --- ParallelTerminationStrategy: PID 20783 died... 19:48:46.759749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20783): Terminated: ok {rc=0} 19:48:46.810284 --- ParallelTerminationStrategy: PID 20784 died... 19:48:46.831272 run iperf3-srv_10.42.42.10(pid=20784): Terminated {rc=256} 19:48:46.881599 --- ParallelTerminationStrategy: PID 20785 died... 19:48:46.902546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20785): Terminated: ok {rc=0} 19:48:46.952787 --- ParallelTerminationStrategy: PID 20786 died... 19:48:46.973752 run iperf3-srv_10.42.42.10(pid=20786): Terminated {rc=256} 19:48:47.024228 --- ParallelTerminationStrategy: PID 20789 died... 19:48:47.045198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20789): Terminated: ok {rc=0} 19:48:47.095664 --- ParallelTerminationStrategy: PID 20792 died... 19:48:47.116683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20792): Terminated: ok {rc=0} 19:48:47.167173 --- ParallelTerminationStrategy: PID 20795 died... 19:48:47.188494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20795): Terminated: ok {rc=0} 19:48:47.279492 bus /gobi_0: Setting Powered False 19:48:48.378937 bus /gobi_0: Setting Powered False 19:48:49.496675 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx iperf3.py ---------------------------------------------- 19:48:50.647698 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:50.659852 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:48:50.713212 tst iperf3.py: using LAC 31098 19:48:50.841351 tst iperf3.py: using RAC 243 19:48:50.969732 tst iperf3.py: using CellId 31098 19:48:51.090734 tst iperf3.py: using BVCI 31099 19:48:51.202862 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.213543 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.224083 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.235033 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.245861 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.256577 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.267615 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.278552 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:48:51.289551 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:48:51.410492 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:48:51.631292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:51.958236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20797): Launched 19:48:52.243097 run iperf3-srv_10.42.42.10(pid=20798): Launched 19:48:52.366674 tst iperf3.py:8: start network... 19:48:52.587106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:53.091570 run create_hlr_db(pid=20799): Launched 19:48:53.216287 bus /gobi_6: Setting Powered False 19:48:54.281183 run create_hlr_db(pid=20799): Terminated: ok {rc=0} 19:48:54.734429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Launched 19:48:55.061244 run osmo-hlr_10.42.42.2(pid=20802): Launched 19:48:55.186028 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:55.751174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Launched 19:48:56.076397 run osmo-stp_10.42.42.5(pid=20805): Launched 19:48:56.200365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:56.761182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20807): Launched 19:48:56.886151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:57.161676 run patchelf(pid=20808): Launched 19:48:57.344410 run osmo-stp_10.42.42.5(pid=20805): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] 19:48:57.483378 run osmo-stp_10.42.42.5(pid=20805): stdout: | (launched: 2022-12-12_19:48:56.016451) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:57.623852 run osmo-stp_10.42.42.5(pid=20805): stderr: | 20221212194856206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194856206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194856206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194856206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194856207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194856207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194856207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:57.764089 run osmo-stp_10.42.42.5(pid=20805): stdout: | (launched: 2022-12-12_19:48:56.016451) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:57.897969 run osmo-stp_10.42.42.5(pid=20805): stderr: | 20221212194856206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194856206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194856206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194856206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194856207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194856207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194856207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:58.056508 run patchelf(pid=20808): Terminating (SIGINT) 19:48:58.238575 run patchelf(pid=20808): Terminated: ok {rc=0} 19:48:58.370551 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20805): Process ended prematurely: osmo-stp_10.42.42.5(pid=20805) [trial-2381↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] [trial-2381↪gprs:trx-umtrx↪iperf3.py:8] 19:48:58.380556 tst iperf3.py:8: Test FAILED (7.8 sec) 19:48:58.410094 run osmo-hlr_10.42.42.2(pid=20802): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20802)] 19:48:58.461180 run osmo-hlr_10.42.42.2(pid=20802): stdout: | (launched: 2022-12-12_19:48:55.001442) 19:48:58.513844 run osmo-hlr_10.42.42.2(pid=20802): stderr: | 20221212194855195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194855195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194855195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194855195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194855195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194855195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194855208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194855216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194855217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194855217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:58.566834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20797): Terminating (SIGTERM) 19:48:58.609459 run iperf3-srv_10.42.42.10(pid=20798): Terminating (SIGTERM) 19:48:58.651756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Terminating (SIGTERM) 19:48:58.694428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Terminating (SIGTERM) 19:48:58.737131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20807): Terminating (SIGTERM) 19:48:58.780106 --- ParallelTerminationStrategy: PID 20797 died... 19:48:58.800404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20797): Terminated: ok {rc=0} 19:48:58.847827 --- ParallelTerminationStrategy: PID 20798 died... 19:48:58.867719 run iperf3-srv_10.42.42.10(pid=20798): Terminated {rc=256} 19:48:58.914842 --- ParallelTerminationStrategy: PID 20801 died... 19:48:58.934566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Terminated: ok {rc=0} 19:48:58.981853 --- ParallelTerminationStrategy: PID 20804 died... 19:48:59.001644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Terminated: ok {rc=0} 19:48:59.048793 --- ParallelTerminationStrategy: PID 20807 died... 19:48:59.068910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20807): Terminated: ok {rc=0} 19:48:59.159708 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 19:49:00.311767 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.323651 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:49:00.374356 tst iperf3m4.py: using LAC 31099 19:49:00.503049 tst iperf3m4.py: using RAC 244 19:49:00.629965 tst iperf3m4.py: using CellId 31099 19:49:00.757227 tst iperf3m4.py: using BVCI 31100 19:49:00.877944 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.889683 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.901490 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.913491 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.925645 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.937509 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.949410 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.961345 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:00.973462 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:49:01.121181 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:49:01.279112 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:49:01.420496 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:49:01.540462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:49:01.758370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:02.081051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20809): Launched 19:49:02.368394 run iperf3-srv_10.42.42.10(pid=20810): Launched 19:49:02.484297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:49:02.687943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:02.993726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20811): Launched 19:49:03.259799 run iperf3-srv_10.42.42.10(pid=20812): Launched 19:49:03.374872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:49:03.577244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:03.882421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20813): Launched 19:49:04.147775 run iperf3-srv_10.42.42.10(pid=20814): Launched 19:49:04.261789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:49:04.465495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:04.770748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20815): Launched 19:49:05.036432 run iperf3-srv_10.42.42.10(pid=20816): Launched 19:49:05.150547 tst iperf3m4.py:8: start network... 19:49:05.352869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:05.823310 run create_hlr_db(pid=20817): Launched 19:49:05.947252 bus /gobi_6: Setting Powered False 19:49:07.011757 run create_hlr_db(pid=20817): Terminated: ok {rc=0} 19:49:07.446248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20819): Launched 19:49:07.750908 run osmo-hlr_10.42.42.2(pid=20820): Launched 19:49:07.866786 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:08.394471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20822): Launched 19:49:08.700196 run osmo-stp_10.42.42.5(pid=20823): Launched 19:49:08.816182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:09.341960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20825): Launched 19:49:09.467604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:09.744735 run patchelf(pid=20826): Launched 19:49:09.927221 run osmo-stp_10.42.42.5(pid=20823): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20823)] 19:49:10.066001 run osmo-stp_10.42.42.5(pid=20823): stdout: | (launched: 2022-12-12_19:49:08.643990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:10.206517 run osmo-stp_10.42.42.5(pid=20823): stderr: | 20221212194908814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194908814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194908814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194908815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194908815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194908815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194908815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:10.347821 run osmo-stp_10.42.42.5(pid=20823): stdout: | (launched: 2022-12-12_19:49:08.643990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:10.481812 run osmo-stp_10.42.42.5(pid=20823): stderr: | 20221212194908814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194908814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194908814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194908815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194908815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194908815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194908815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:10.640621 run patchelf(pid=20826): Terminating (SIGINT) 19:49:10.823220 run patchelf(pid=20826): Terminated: ok {rc=0} 19:49:10.955178 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20823): Process ended prematurely: osmo-stp_10.42.42.5(pid=20823) [trial-2381↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20823)] [trial-2381↪gprs:trx-umtrx↪iperf3m4.py:8] 19:49:10.965338 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:49:10.994951 run osmo-hlr_10.42.42.2(pid=20820): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20820)] 19:49:11.045727 run osmo-hlr_10.42.42.2(pid=20820): stdout: | (launched: 2022-12-12_19:49:07.694719) 19:49:11.098593 run osmo-hlr_10.42.42.2(pid=20820): stderr: | 20221212194907865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194907865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194907866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194907866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194907866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194907866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194907876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194907885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194907885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194907885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:11.152229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20809): Terminating (SIGTERM) 19:49:11.194707 run iperf3-srv_10.42.42.10(pid=20810): Terminating (SIGTERM) 19:49:11.237093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20811): Terminating (SIGTERM) 19:49:11.279593 run iperf3-srv_10.42.42.10(pid=20812): Terminating (SIGTERM) 19:49:11.322414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20813): Terminating (SIGTERM) 19:49:11.365027 run iperf3-srv_10.42.42.10(pid=20814): Terminating (SIGTERM) 19:49:11.407481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20815): Terminating (SIGTERM) 19:49:11.450088 run iperf3-srv_10.42.42.10(pid=20816): Terminating (SIGTERM) 19:49:11.492390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20819): Terminating (SIGTERM) 19:49:11.535155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20822): Terminating (SIGTERM) 19:49:11.577648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20825): Terminating (SIGTERM) 19:49:11.620347 --- ParallelTerminationStrategy: PID 20809 died... 19:49:11.640623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20809): Terminated: ok {rc=0} 19:49:11.687750 --- ParallelTerminationStrategy: PID 20810 died... 19:49:11.707508 run iperf3-srv_10.42.42.10(pid=20810): Terminated {rc=256} 19:49:11.754900 --- ParallelTerminationStrategy: PID 20811 died... 19:49:11.774645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20811): Terminated: ok {rc=0} 19:49:11.821928 --- ParallelTerminationStrategy: PID 20812 died... 19:49:11.841640 run iperf3-srv_10.42.42.10(pid=20812): Terminated {rc=256} 19:49:11.888575 --- ParallelTerminationStrategy: PID 20813 died... 19:49:11.908866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20813): Terminated: ok {rc=0} 19:49:11.956490 --- ParallelTerminationStrategy: PID 20814 died... 19:49:11.976625 run iperf3-srv_10.42.42.10(pid=20814): Terminated {rc=256} 19:49:12.023657 --- ParallelTerminationStrategy: PID 20815 died... 19:49:12.043486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20815): Terminated: ok {rc=0} 19:49:12.091046 --- ParallelTerminationStrategy: PID 20816 died... 19:49:12.110724 run iperf3-srv_10.42.42.10(pid=20816): Terminated {rc=256} 19:49:12.158091 --- ParallelTerminationStrategy: PID 20819 died... 19:49:12.177693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20819): Terminated: ok {rc=0} 19:49:12.225195 --- ParallelTerminationStrategy: PID 20822 died... 19:49:12.245135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20822): Terminated: ok {rc=0} 19:49:12.292570 --- ParallelTerminationStrategy: PID 20825 died... 19:49:12.312456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20825): Terminated: ok {rc=0} 19:49:12.402333 bus /gobi_4: Setting Powered False 19:49:13.503403 bus /gobi_4: Setting Powered False 19:49:14.620619 bus /gobi_1: Setting Powered False 19:49:15.721101 bus /gobi_1: Setting Powered False 19:49:16.849381 bus /gobi_0: Setting Powered False 19:49:17.963230 bus /gobi_0: Setting Powered False 19:49:19.080663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx ping.py ---------------------------------------------- 19:49:20.186066 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.197491 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:49:20.245896 tst ping.py: using LAC 31100 19:49:20.364090 tst ping.py: using RAC 245 19:49:20.480234 tst ping.py: using CellId 31100 19:49:20.599300 tst ping.py: using BVCI 31101 19:49:20.708257 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.718852 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.729391 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.739781 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.750115 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.760438 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.770933 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:20.781462 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:49:20.898382 tst ping.py:19: start network... 19:49:21.114902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:21.611080 run create_hlr_db(pid=20828): Launched 19:49:21.734343 bus /gobi_6: Setting Powered False 19:49:22.799138 run create_hlr_db(pid=20828): Terminated: ok {rc=0} 19:49:23.245097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20830): Launched 19:49:23.564911 run osmo-hlr_10.42.42.2(pid=20831): Launched 19:49:23.688602 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:24.239892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20833): Launched 19:49:24.562866 run osmo-stp_10.42.42.5(pid=20834): Launched 19:49:24.686685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:25.238762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20836): Launched 19:49:25.364280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:25.635603 run patchelf(pid=20837): Launched 19:49:25.815713 run osmo-stp_10.42.42.5(pid=20834): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20834)] 19:49:25.951736 run osmo-stp_10.42.42.5(pid=20834): stdout: | (launched: 2022-12-12_19:49:24.504202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:26.089098 run osmo-stp_10.42.42.5(pid=20834): stderr: | 20221212194924693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194924693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194924693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194924694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194924694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194924694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194924694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:26.226132 run osmo-stp_10.42.42.5(pid=20834): stdout: | (launched: 2022-12-12_19:49:24.504202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:26.357850 run osmo-stp_10.42.42.5(pid=20834): stderr: | 20221212194924693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194924693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194924693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194924694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194924694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194924694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194924694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:26.513375 run patchelf(pid=20837): Terminating (SIGINT) 19:49:26.692711 run patchelf(pid=20837): Terminated: ok {rc=0} 19:49:26.821717 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20834): Process ended prematurely: osmo-stp_10.42.42.5(pid=20834) [trial-2381↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20834)] [trial-2381↪gprs:trx-umtrx↪ping.py:22] 19:49:26.831240 tst ping.py:22: Test FAILED (6.6 sec) 19:49:26.859900 run osmo-hlr_10.42.42.2(pid=20831): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20831)] 19:49:26.911698 run osmo-hlr_10.42.42.2(pid=20831): stdout: | (launched: 2022-12-12_19:49:23.506410) 19:49:26.964738 run osmo-hlr_10.42.42.2(pid=20831): stderr: | 20221212194923701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194923701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194923701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194923701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194923701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194923701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194923714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194923722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194923722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194923723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:27.017961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20830): Terminating (SIGTERM) 19:49:27.060434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20833): Terminating (SIGTERM) 19:49:27.103029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20836): Terminating (SIGTERM) 19:49:27.145755 --- ParallelTerminationStrategy: PID 20830 died... 19:49:27.165928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20830): Terminated: ok {rc=0} 19:49:27.213750 --- ParallelTerminationStrategy: PID 20833 died... 19:49:27.234031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20833): Terminated: ok {rc=0} 19:49:27.281506 --- ParallelTerminationStrategy: PID 20836 died... 19:49:27.301801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20836): Terminated: ok {rc=0} 19:49:27.391394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 19:49:28.476360 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:28.487854 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:49:28.538002 tst ping_idle_ping.py: using LAC 31101 19:49:28.665187 tst ping_idle_ping.py: using RAC 246 19:49:28.783526 tst ping_idle_ping.py: using CellId 31101 19:49:28.901968 tst ping_idle_ping.py: using BVCI 31102 19:49:29.009865 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:29.020690 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:29.031464 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:29.041999 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:29.052461 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:29.062918 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:29.073476 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:49:29.084018 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:49:29.199044 tst ping_idle_ping.py:24: start network... 19:49:29.416937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:29.914895 run create_hlr_db(pid=20838): Launched 19:49:30.037810 bus /gobi_6: Setting Powered False 19:49:31.102108 run create_hlr_db(pid=20838): Terminated: ok {rc=0} 19:49:31.560443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20840): Launched 19:49:31.930649 run osmo-hlr_10.42.42.2(pid=20841): Launched 19:49:32.157840 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:32.689765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20843): Launched 19:49:32.987733 run osmo-stp_10.42.42.5(pid=20844): Launched 19:49:33.101710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:33.617093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20846): Launched 19:49:33.734316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:33.987064 run patchelf(pid=20847): Launched 19:49:34.153845 run osmo-stp_10.42.42.5(pid=20844): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20844)] 19:49:34.280057 run osmo-stp_10.42.42.5(pid=20844): stdout: | (launched: 2022-12-12_19:49:32.932820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:34.408748 run osmo-stp_10.42.42.5(pid=20844): stderr: | 20221212194933101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194933101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194933101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194933102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194933102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194933102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194933102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:34.549470 run osmo-stp_10.42.42.5(pid=20844): stdout: | (launched: 2022-12-12_19:49:32.932820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:34.682418 run osmo-stp_10.42.42.5(pid=20844): stderr: | 20221212194933101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194933101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194933101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194933102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194933102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194933102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194933102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:34.838999 run patchelf(pid=20847): Terminating (SIGINT) 19:49:35.019023 run patchelf(pid=20847): Terminated: ok {rc=0} 19:49:35.149264 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20844): Process ended prematurely: osmo-stp_10.42.42.5(pid=20844) [trial-2381↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20844)] [trial-2381↪gprs:trx-umtrx↪ping_idle_ping.py:27] 19:49:35.159151 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:49:35.188352 run osmo-hlr_10.42.42.2(pid=20841): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20841)] 19:49:35.239599 run osmo-hlr_10.42.42.2(pid=20841): stdout: | (launched: 2022-12-12_19:49:31.871404) 19:49:35.292696 run osmo-hlr_10.42.42.2(pid=20841): stderr: | 20221212194932060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194932060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194932060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194932060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194932060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194932060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194932074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194932088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194932088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194932088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:35.346568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20840): Terminating (SIGTERM) 19:49:35.389321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20843): Terminating (SIGTERM) 19:49:35.432021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20846): Terminating (SIGTERM) 19:49:35.475205 --- ParallelTerminationStrategy: PID 20840 died... 19:49:35.495765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20840): Terminated: ok {rc=0} 19:49:35.543819 --- ParallelTerminationStrategy: PID 20843 died... 19:49:35.563938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20843): Terminated: ok {rc=0} 19:49:35.611759 --- ParallelTerminationStrategy: PID 20846 died... 19:49:35.631848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20846): Terminated: ok {rc=0} 19:49:35.722480 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 19:49:37.027584 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:49:37.033299 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:49:37.067815 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:49:37.107438 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:49:37.200672 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:49:37.235136 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:49:37.274914 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:49:37.864803 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:49:37.918050 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:37.929502 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:49:37.978782 tst cs_paging_gprs_active.py: using LAC 31102 19:49:38.106091 tst cs_paging_gprs_active.py: using RAC 247 19:49:38.233305 tst cs_paging_gprs_active.py: using CellId 31102 19:49:38.360305 tst cs_paging_gprs_active.py: using BVCI 31103 19:49:38.478741 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.490139 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.501262 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.512708 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.524135 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.535471 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.547045 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.558329 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:38.570001 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:38.687549 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:38.807839 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:49:39.029519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:39.358272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20856): Launched 19:49:39.643480 run iperf3-srv_10.42.42.10(pid=20857): Launched 19:49:39.767609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:49:39.988377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:40.317314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20858): Launched 19:49:40.602852 run iperf3-srv_10.42.42.10(pid=20859): Launched 19:49:40.727142 tst cs_paging_gprs_active.py:38: start network... 19:49:40.947729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:41.454794 run create_hlr_db(pid=20860): Launched 19:49:41.581795 bus /gobi_6: Setting Powered False 19:49:42.645807 run create_hlr_db(pid=20860): Terminated: ok {rc=0} 19:49:43.083544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20862): Launched 19:49:43.388595 run osmo-hlr_10.42.42.2(pid=20863): Launched 19:49:43.504941 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:44.029599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20865): Launched 19:49:44.333936 run osmo-stp_10.42.42.5(pid=20866): Launched 19:49:44.450814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:44.975377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20868): Launched 19:49:45.091874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:45.348203 run patchelf(pid=20869): Launched 19:49:45.517554 run osmo-stp_10.42.42.5(pid=20866): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20866)] 19:49:45.646228 run osmo-stp_10.42.42.5(pid=20866): stdout: | (launched: 2022-12-12_19:49:44.277645) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:45.776149 run osmo-stp_10.42.42.5(pid=20866): stderr: | 20221212194944445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194944445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194944446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194944446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194944447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194944447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194944447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:45.925200 run osmo-stp_10.42.42.5(pid=20866): stdout: | (launched: 2022-12-12_19:49:44.277645) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:46.065089 run osmo-stp_10.42.42.5(pid=20866): stderr: | 20221212194944445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194944445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194944446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194944446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194944447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194944447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194944447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:46.228410 run patchelf(pid=20869): Terminating (SIGINT) 19:49:46.418035 run patchelf(pid=20869): Terminated: ok {rc=0} 19:49:46.555353 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20866): Process ended prematurely: osmo-stp_10.42.42.5(pid=20866) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20866)] [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:49:46.566756 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:49:46.600063 run osmo-hlr_10.42.42.2(pid=20863): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20863)] 19:49:46.653193 run osmo-hlr_10.42.42.2(pid=20863): stdout: | (launched: 2022-12-12_19:49:43.332266) 19:49:46.708059 run osmo-hlr_10.42.42.2(pid=20863): stderr: | 20221212194943506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194943506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194943506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194943506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194943506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194943506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194943519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194943527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194943527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194943527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:46.765318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20856): Terminating (SIGTERM) 19:49:46.809963 run iperf3-srv_10.42.42.10(pid=20857): Terminating (SIGTERM) 19:49:46.856185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20858): Terminating (SIGTERM) 19:49:46.902506 run iperf3-srv_10.42.42.10(pid=20859): Terminating (SIGTERM) 19:49:46.958226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20862): Terminating (SIGTERM) 19:49:47.009699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20865): Terminating (SIGTERM) 19:49:47.059212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20868): Terminating (SIGTERM) 19:49:47.101223 --- ParallelTerminationStrategy: PID 20856 died... 19:49:47.120512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20856): Terminated: ok {rc=0} 19:49:47.166083 --- ParallelTerminationStrategy: PID 20857 died... 19:49:47.185709 run iperf3-srv_10.42.42.10(pid=20857): Terminated {rc=256} 19:49:47.229951 --- ParallelTerminationStrategy: PID 20858 died... 19:49:47.248737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20858): Terminated: ok {rc=0} 19:49:47.293295 --- ParallelTerminationStrategy: PID 20859 died... 19:49:47.311878 run iperf3-srv_10.42.42.10(pid=20859): Terminated {rc=256} 19:49:47.356197 --- ParallelTerminationStrategy: PID 20862 died... 19:49:47.375075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20862): Terminated: ok {rc=0} 19:49:47.419053 --- ParallelTerminationStrategy: PID 20865 died... 19:49:47.437798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20865): Terminated: ok {rc=0} 19:49:47.481795 --- ParallelTerminationStrategy: PID 20868 died... 19:49:47.500583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20868): Terminated: ok {rc=0} 19:49:47.587461 bus /gobi_0: Setting Powered False 19:49:48.687918 bus /gobi_0: Setting Powered False 19:49:49.807034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:49:50.958226 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:50.970470 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:49:51.025566 tst iperf3.py: using LAC 31103 19:49:51.147764 tst iperf3.py: using RAC 248 19:49:51.268889 tst iperf3.py: using CellId 31103 19:49:51.388659 tst iperf3.py: using BVCI 31104 19:49:51.498726 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.509714 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.520339 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.531136 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.541754 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.552310 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.563184 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.573801 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:51.584645 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:51.703372 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:49:51.923701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:52.251618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20870): Launched 19:49:52.538749 run iperf3-srv_10.42.42.10(pid=20871): Launched 19:49:52.663116 tst iperf3.py:8: start network... 19:49:52.882870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:53.388055 run create_hlr_db(pid=20872): Launched 19:49:53.512796 bus /gobi_6: Setting Powered False 19:49:54.576838 run create_hlr_db(pid=20872): Terminated: ok {rc=0} 19:49:55.010366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20874): Launched 19:49:55.314722 run osmo-hlr_10.42.42.2(pid=20875): Launched 19:49:55.430375 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:55.958627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20877): Launched 19:49:56.261625 run osmo-stp_10.42.42.5(pid=20878): Launched 19:49:56.376847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:56.896326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20880): Launched 19:49:57.012309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:57.267829 run patchelf(pid=20881): Launched 19:49:57.436204 run osmo-stp_10.42.42.5(pid=20878): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20878)] 19:49:57.564337 run osmo-stp_10.42.42.5(pid=20878): stdout: | (launched: 2022-12-12_19:49:56.205847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:57.694218 run osmo-stp_10.42.42.5(pid=20878): stderr: | 20221212194956375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194956375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194956375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194956375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194956376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194956376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194956376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:57.824371 run osmo-stp_10.42.42.5(pid=20878): stdout: | (launched: 2022-12-12_19:49:56.205847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:57.947758 run osmo-stp_10.42.42.5(pid=20878): stderr: | 20221212194956375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212194956375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212194956375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212194956375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212194956376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212194956376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212194956376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:58.094078 run patchelf(pid=20881): Terminating (SIGINT) 19:49:58.263750 run patchelf(pid=20881): Terminated: ok {rc=0} 19:49:58.385657 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20878): Process ended prematurely: osmo-stp_10.42.42.5(pid=20878) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20878)] [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 19:49:58.395060 tst iperf3.py:8: Test FAILED (7.5 sec) 19:49:58.422246 run osmo-hlr_10.42.42.2(pid=20875): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20875)] 19:49:58.469487 run osmo-hlr_10.42.42.2(pid=20875): stdout: | (launched: 2022-12-12_19:49:55.258758) 19:49:58.518740 run osmo-hlr_10.42.42.2(pid=20875): stderr: | 20221212194955431 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212194955431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212194955431 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212194955431 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212194955431 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212194955431 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212194955444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212194955454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212194955454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212194955454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:58.568511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20870): Terminating (SIGTERM) 19:49:58.608109 run iperf3-srv_10.42.42.10(pid=20871): Terminating (SIGTERM) 19:49:58.647593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20874): Terminating (SIGTERM) 19:49:58.687067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20877): Terminating (SIGTERM) 19:49:58.726801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20880): Terminating (SIGTERM) 19:49:58.766606 --- ParallelTerminationStrategy: PID 20870 died... 19:49:58.785744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20870): Terminated: ok {rc=0} 19:49:58.830545 --- ParallelTerminationStrategy: PID 20871 died... 19:49:58.849220 run iperf3-srv_10.42.42.10(pid=20871): Terminated {rc=256} 19:49:58.893545 --- ParallelTerminationStrategy: PID 20874 died... 19:49:58.912067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20874): Terminated: ok {rc=0} 19:49:58.955599 --- ParallelTerminationStrategy: PID 20877 died... 19:49:58.974163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20877): Terminated: ok {rc=0} 19:49:59.018030 --- ParallelTerminationStrategy: PID 20880 died... 19:49:59.036669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20880): Terminated: ok {rc=0} 19:49:59.122989 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:50:00.270943 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.282509 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:50:00.333222 tst iperf3m4.py: using LAC 31104 19:50:00.453550 tst iperf3m4.py: using RAC 249 19:50:00.583883 tst iperf3m4.py: using CellId 31104 19:50:00.711107 tst iperf3m4.py: using BVCI 31105 19:50:00.830706 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.846367 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.862390 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.879235 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.898988 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.912174 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.930232 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.943719 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:00.956061 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:50:01.084655 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:50:01.207301 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:50:01.331442 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:50:01.465974 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:50:01.676556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:01.991595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20885): Launched 19:50:02.274687 run iperf3-srv_10.42.42.10(pid=20886): Launched 19:50:02.403382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:50:02.623476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:02.951663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20887): Launched 19:50:03.238453 run iperf3-srv_10.42.42.10(pid=20888): Launched 19:50:03.363702 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:50:03.584098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:03.912898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20889): Launched 19:50:04.199729 run iperf3-srv_10.42.42.10(pid=20890): Launched 19:50:04.324485 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:50:04.544903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:04.873400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20891): Launched 19:50:05.159942 run iperf3-srv_10.42.42.10(pid=20892): Launched 19:50:05.284031 tst iperf3m4.py:8: start network... 19:50:05.504919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:06.010727 run create_hlr_db(pid=20893): Launched 19:50:06.136700 bus /gobi_6: Setting Powered False 19:50:07.201908 run create_hlr_db(pid=20893): Terminated: ok {rc=0} 19:50:07.656831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20895): Launched 19:50:07.985626 run osmo-hlr_10.42.42.2(pid=20896): Launched 19:50:08.113247 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:08.676533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20898): Launched 19:50:09.006173 run osmo-stp_10.42.42.5(pid=20899): Launched 19:50:09.131608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:09.696430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20901): Launched 19:50:09.823611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:10.100203 run patchelf(pid=20902): Launched 19:50:10.283570 run osmo-stp_10.42.42.5(pid=20899): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20899)] 19:50:10.423847 run osmo-stp_10.42.42.5(pid=20899): stdout: | (launched: 2022-12-12_19:50:08.945716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:10.566321 run osmo-stp_10.42.42.5(pid=20899): stderr: | 20221212195009134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195009135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195009135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195009135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195009136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195009136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195009136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:10.707254 run osmo-stp_10.42.42.5(pid=20899): stdout: | (launched: 2022-12-12_19:50:08.945716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:10.841828 run osmo-stp_10.42.42.5(pid=20899): stderr: | 20221212195009134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195009135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195009135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195009135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195009136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195009136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195009136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:11.001526 run patchelf(pid=20902): Terminating (SIGINT) 19:50:11.184761 run patchelf(pid=20902): Terminated: ok {rc=0} 19:50:11.317813 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20899): Process ended prematurely: osmo-stp_10.42.42.5(pid=20899) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20899)] [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 19:50:11.328137 tst iperf3m4.py:8: Test FAILED (11.1 sec) 19:50:11.358010 run osmo-hlr_10.42.42.2(pid=20896): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20896)] 19:50:11.409478 run osmo-hlr_10.42.42.2(pid=20896): stdout: | (launched: 2022-12-12_19:50:07.925611) 19:50:11.462181 run osmo-hlr_10.42.42.2(pid=20896): stderr: | 20221212195008120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195008120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195008120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195008120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195008120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195008120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195008150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195008159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195008160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195008160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:11.515456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20885): Terminating (SIGTERM) 19:50:11.557793 run iperf3-srv_10.42.42.10(pid=20886): Terminating (SIGTERM) 19:50:11.600020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20887): Terminating (SIGTERM) 19:50:11.642622 run iperf3-srv_10.42.42.10(pid=20888): Terminating (SIGTERM) 19:50:11.685035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20889): Terminating (SIGTERM) 19:50:11.727615 run iperf3-srv_10.42.42.10(pid=20890): Terminating (SIGTERM) 19:50:11.769845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20891): Terminating (SIGTERM) 19:50:11.812228 run iperf3-srv_10.42.42.10(pid=20892): Terminating (SIGTERM) 19:50:11.854590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20895): Terminating (SIGTERM) 19:50:11.897127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20898): Terminating (SIGTERM) 19:50:11.939354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20901): Terminating (SIGTERM) 19:50:11.982021 --- ParallelTerminationStrategy: PID 20885 died... 19:50:12.002346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20885): Terminated: ok {rc=0} 19:50:12.049570 --- ParallelTerminationStrategy: PID 20886 died... 19:50:12.069218 run iperf3-srv_10.42.42.10(pid=20886): Terminated {rc=256} 19:50:12.116230 --- ParallelTerminationStrategy: PID 20887 died... 19:50:12.135986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20887): Terminated: ok {rc=0} 19:50:12.183021 --- ParallelTerminationStrategy: PID 20888 died... 19:50:12.202753 run iperf3-srv_10.42.42.10(pid=20888): Terminated {rc=256} 19:50:12.249709 --- ParallelTerminationStrategy: PID 20889 died... 19:50:12.269505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20889): Terminated: ok {rc=0} 19:50:12.316767 --- ParallelTerminationStrategy: PID 20890 died... 19:50:12.336619 run iperf3-srv_10.42.42.10(pid=20890): Terminated {rc=256} 19:50:12.383889 --- ParallelTerminationStrategy: PID 20891 died... 19:50:12.403782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20891): Terminated: ok {rc=0} 19:50:12.450863 --- ParallelTerminationStrategy: PID 20892 died... 19:50:12.470748 run iperf3-srv_10.42.42.10(pid=20892): Terminated {rc=256} 19:50:12.517753 --- ParallelTerminationStrategy: PID 20895 died... 19:50:12.537618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20895): Terminated: ok {rc=0} 19:50:12.584872 --- ParallelTerminationStrategy: PID 20898 died... 19:50:12.604846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20898): Terminated: ok {rc=0} 19:50:12.652032 --- ParallelTerminationStrategy: PID 20901 died... 19:50:12.671809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20901): Terminated: ok {rc=0} 19:50:12.760863 bus /gobi_4: Setting Powered False 19:50:13.859783 bus /gobi_4: Setting Powered False 19:50:14.978727 bus /gobi_1: Setting Powered False 19:50:16.081998 bus /gobi_1: Setting Powered False 19:50:17.203477 bus /gobi_0: Setting Powered False 19:50:18.298401 bus /gobi_0: Setting Powered False 19:50:19.414898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 19:50:20.520306 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:20.532583 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:50:20.584124 tst ping.py: using LAC 31105 19:50:20.701094 tst ping.py: using RAC 250 19:50:20.817386 tst ping.py: using CellId 31105 19:50:20.934204 tst ping.py: using BVCI 31106 19:50:21.043859 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:21.055105 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:21.066020 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:21.076810 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:21.087470 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:21.098232 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:21.109141 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:21.119857 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:50:21.237558 tst ping.py:19: start network... 19:50:21.454197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:21.950434 run create_hlr_db(pid=20903): Launched 19:50:22.075375 bus /gobi_6: Setting Powered False 19:50:23.139306 run create_hlr_db(pid=20903): Terminated: ok {rc=0} 19:50:23.568624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20905): Launched 19:50:23.868483 run osmo-hlr_10.42.42.2(pid=20906): Launched 19:50:23.982291 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:24.497160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20908): Launched 19:50:24.794107 run osmo-stp_10.42.42.5(pid=20909): Launched 19:50:24.907049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:25.435074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20911): Launched 19:50:25.550694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:25.802309 run patchelf(pid=20912): Launched 19:50:25.970210 run osmo-stp_10.42.42.5(pid=20909): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20909)] 19:50:26.096444 run osmo-stp_10.42.42.5(pid=20909): stdout: | (launched: 2022-12-12_19:50:24.738641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:26.224217 run osmo-stp_10.42.42.5(pid=20909): stderr: | 20221212195024905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195024905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195024906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195024906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195024906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195024907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195024907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:26.352099 run osmo-stp_10.42.42.5(pid=20909): stdout: | (launched: 2022-12-12_19:50:24.738641) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:26.473782 run osmo-stp_10.42.42.5(pid=20909): stderr: | 20221212195024905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195024905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195024906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195024906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195024906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195024907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195024907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:26.618224 run patchelf(pid=20912): Terminating (SIGINT) 19:50:26.784845 run patchelf(pid=20912): Terminated: ok {rc=0} 19:50:26.904510 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20909): Process ended prematurely: osmo-stp_10.42.42.5(pid=20909) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20909)] [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 19:50:26.913640 tst ping.py:22: Test FAILED (6.4 sec) 19:50:26.940643 run osmo-hlr_10.42.42.2(pid=20906): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20906)] 19:50:26.988607 run osmo-hlr_10.42.42.2(pid=20906): stdout: | (launched: 2022-12-12_19:50:23.812890) 19:50:27.038428 run osmo-hlr_10.42.42.2(pid=20906): stderr: | 20221212195023986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195023986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195023986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195023986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195023986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195023986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195023998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195024007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195024007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195024007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:27.089096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20905): Terminating (SIGTERM) 19:50:27.129675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20908): Terminating (SIGTERM) 19:50:27.170047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20911): Terminating (SIGTERM) 19:50:27.210700 --- ParallelTerminationStrategy: PID 20905 died... 19:50:27.230077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20905): Terminated: ok {rc=0} 19:50:27.275064 --- ParallelTerminationStrategy: PID 20908 died... 19:50:27.294040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20908): Terminated: ok {rc=0} 19:50:27.338425 --- ParallelTerminationStrategy: PID 20911 died... 19:50:27.357395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20911): Terminated: ok {rc=0} 19:50:27.443835 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:50:28.533913 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:28.546227 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:50:28.604286 tst ping_idle_ping.py: using LAC 31106 19:50:28.729386 tst ping_idle_ping.py: using RAC 251 19:50:28.853746 tst ping_idle_ping.py: using CellId 31106 19:50:28.977113 tst ping_idle_ping.py: using BVCI 31107 19:50:29.085932 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:29.096940 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:29.108612 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:29.120338 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:29.131518 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:29.142793 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:29.154217 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:29.165575 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:50:29.286081 tst ping_idle_ping.py:24: start network... 19:50:29.505219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:30.006722 run create_hlr_db(pid=20913): Launched 19:50:30.131446 bus /gobi_6: Setting Powered False 19:50:31.194133 run create_hlr_db(pid=20913): Terminated: ok {rc=0} 19:50:31.654958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20915): Launched 19:50:31.994026 run osmo-hlr_10.42.42.2(pid=20916): Launched 19:50:32.189486 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:32.752023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Launched 19:50:33.075470 run osmo-stp_10.42.42.5(pid=20919): Launched 19:50:33.200659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:33.758580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20921): Launched 19:50:33.884492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:34.158274 run patchelf(pid=20922): Launched 19:50:34.339850 run osmo-stp_10.42.42.5(pid=20919): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20919)] 19:50:34.479132 run osmo-stp_10.42.42.5(pid=20919): stdout: | (launched: 2022-12-12_19:50:33.016145) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:34.618124 run osmo-stp_10.42.42.5(pid=20919): stderr: | 20221212195033206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195033206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195033206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195033207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195033207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195033207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195033207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:34.757139 run osmo-stp_10.42.42.5(pid=20919): stdout: | (launched: 2022-12-12_19:50:33.016145) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:34.890200 run osmo-stp_10.42.42.5(pid=20919): stderr: | 20221212195033206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195033206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195033206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195033207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195033207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195033207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195033207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:35.047897 run patchelf(pid=20922): Terminating (SIGINT) 19:50:35.229376 run patchelf(pid=20922): Terminated: ok {rc=0} 19:50:35.360017 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20919): Process ended prematurely: osmo-stp_10.42.42.5(pid=20919) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20919)] [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 19:50:35.369884 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:50:35.399343 run osmo-hlr_10.42.42.2(pid=20916): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20916)] 19:50:35.450737 run osmo-hlr_10.42.42.2(pid=20916): stdout: | (launched: 2022-12-12_19:50:31.933690) 19:50:35.503994 run osmo-hlr_10.42.42.2(pid=20916): stderr: | 20221212195032189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195032189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195032189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195032189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195032189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195032190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195032202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195032210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195032210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195032210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:35.557382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20915): Terminating (SIGTERM) 19:50:35.600453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Terminating (SIGTERM) 19:50:35.643662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20921): Terminating (SIGTERM) 19:50:35.687030 --- ParallelTerminationStrategy: PID 20915 died... 19:50:35.707469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20915): Terminated: ok {rc=0} 19:50:35.755622 --- ParallelTerminationStrategy: PID 20918 died... 19:50:35.775631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Terminated: ok {rc=0} 19:50:35.823627 --- ParallelTerminationStrategy: PID 20921 died... 19:50:35.843665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20921): Terminated: ok {rc=0} 19:50:35.934081 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:50:37.243789 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:50:37.250792 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:50:37.285969 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:50:37.326426 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:50:37.415167 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:50:37.447673 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:50:37.485947 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:50:38.079133 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:50:38.128300 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.139230 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:50:38.206487 tst cs_paging_gprs_active.py: using LAC 31107 19:50:38.329665 tst cs_paging_gprs_active.py: using RAC 252 19:50:38.448460 tst cs_paging_gprs_active.py: using CellId 31107 19:50:38.566500 tst cs_paging_gprs_active.py: using BVCI 31108 19:50:38.678746 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.689725 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.700553 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.711387 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.722072 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.732686 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.743567 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.754274 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:38.765160 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:38.882819 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:39.003728 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:50:39.227035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:39.556552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20926): Launched 19:50:39.845116 run iperf3-srv_10.42.42.10(pid=20927): Launched 19:50:39.968408 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:50:40.188611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:40.518468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20928): Launched 19:50:40.805388 run iperf3-srv_10.42.42.10(pid=20929): Launched 19:50:40.927742 tst cs_paging_gprs_active.py:38: start network... 19:50:41.147482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:41.653257 run create_hlr_db(pid=20930): Launched 19:50:41.780312 bus /gobi_6: Setting Powered False 19:50:42.845639 run create_hlr_db(pid=20930): Terminated: ok {rc=0} 19:50:43.302017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20932): Launched 19:50:43.630059 run osmo-hlr_10.42.42.2(pid=20933): Launched 19:50:43.756617 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:44.319881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20935): Launched 19:50:44.649697 run osmo-stp_10.42.42.5(pid=20936): Launched 19:50:44.776472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:45.342195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20938): Launched 19:50:45.469565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:45.753386 run patchelf(pid=20939): Launched 19:50:45.945222 run osmo-stp_10.42.42.5(pid=20936): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20936)] 19:50:46.094859 run osmo-stp_10.42.42.5(pid=20936): stdout: | (launched: 2022-12-12_19:50:44.589656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:46.274103 run osmo-stp_10.42.42.5(pid=20936): stderr: | 20221212195044780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195044780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195044780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195044781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195044781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195044781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195044781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:46.452524 run osmo-stp_10.42.42.5(pid=20936): stdout: | (launched: 2022-12-12_19:50:44.589656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:46.621891 run osmo-stp_10.42.42.5(pid=20936): stderr: | 20221212195044780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195044780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195044780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195044781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195044781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195044781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195044781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:46.792362 run patchelf(pid=20939): Terminating (SIGINT) 19:50:46.982759 run patchelf(pid=20939): Terminated: ok {rc=0} 19:50:47.120194 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20936): Process ended prematurely: osmo-stp_10.42.42.5(pid=20936) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20936)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:50:47.131621 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 19:50:47.165536 run osmo-hlr_10.42.42.2(pid=20933): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20933)] 19:50:47.218693 run osmo-hlr_10.42.42.2(pid=20933): stdout: | (launched: 2022-12-12_19:50:43.569900) 19:50:47.273583 run osmo-hlr_10.42.42.2(pid=20933): stderr: | 20221212195043767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195043767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195043767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195043767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195043767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195043768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195043779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195043788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195043788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195043788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:47.330021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20926): Terminating (SIGTERM) 19:50:47.373872 run iperf3-srv_10.42.42.10(pid=20927): Terminating (SIGTERM) 19:50:47.416793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20928): Terminating (SIGTERM) 19:50:47.459673 run iperf3-srv_10.42.42.10(pid=20929): Terminating (SIGTERM) 19:50:47.502659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20932): Terminating (SIGTERM) 19:50:47.545516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20935): Terminating (SIGTERM) 19:50:47.588493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20938): Terminating (SIGTERM) 19:50:47.632020 --- ParallelTerminationStrategy: PID 20926 died... 19:50:47.652027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20926): Terminated: ok {rc=0} 19:50:47.700420 --- ParallelTerminationStrategy: PID 20927 died... 19:50:47.720325 run iperf3-srv_10.42.42.10(pid=20927): Terminated {rc=256} 19:50:47.768317 --- ParallelTerminationStrategy: PID 20928 died... 19:50:47.788141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20928): Terminated: ok {rc=0} 19:50:47.836226 --- ParallelTerminationStrategy: PID 20929 died... 19:50:47.856268 run iperf3-srv_10.42.42.10(pid=20929): Terminated {rc=256} 19:50:47.904521 --- ParallelTerminationStrategy: PID 20932 died... 19:50:47.924546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20932): Terminated: ok {rc=0} 19:50:47.972871 --- ParallelTerminationStrategy: PID 20935 died... 19:50:47.993291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20935): Terminated: ok {rc=0} 19:50:48.041932 --- ParallelTerminationStrategy: PID 20938 died... 19:50:48.061913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20938): Terminated: ok {rc=0} 19:50:48.152587 bus /gobi_0: Setting Powered False 19:50:49.252198 bus /gobi_0: Setting Powered False 19:50:50.368699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:50:51.518558 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:51.530803 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:50:51.602018 tst iperf3.py: using LAC 31108 19:50:51.729338 tst iperf3.py: using RAC 253 19:50:51.856287 tst iperf3.py: using CellId 31108 19:50:51.984281 tst iperf3.py: using BVCI 31109 19:50:52.104094 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.115666 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.126910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.138637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.150258 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.161981 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.173547 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.184860 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:52.196780 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:52.317501 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:50:52.538904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:52.867097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20940): Launched 19:50:53.153840 run iperf3-srv_10.42.42.10(pid=20941): Launched 19:50:53.278673 tst iperf3.py:8: start network... 19:50:53.499970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:54.005472 run create_hlr_db(pid=20942): Launched 19:50:54.129756 bus /gobi_6: Setting Powered False 19:50:55.194673 run create_hlr_db(pid=20942): Terminated: ok {rc=0} 19:50:55.631487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20944): Launched 19:50:55.937108 run osmo-hlr_10.42.42.2(pid=20945): Launched 19:50:56.055837 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:56.700088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20947): Launched 19:50:56.997386 run osmo-stp_10.42.42.5(pid=20948): Launched 19:50:57.110205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:57.625452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20950): Launched 19:50:57.739837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:57.991168 run patchelf(pid=20951): Launched 19:50:58.158424 run osmo-stp_10.42.42.5(pid=20948): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20948)] 19:50:58.284546 run osmo-stp_10.42.42.5(pid=20948): stdout: | (launched: 2022-12-12_19:50:56.942551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:58.413227 run osmo-stp_10.42.42.5(pid=20948): stderr: | 20221212195057109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195057110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195057110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195057110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195057111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195057111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195057111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:58.541547 run osmo-stp_10.42.42.5(pid=20948): stdout: | (launched: 2022-12-12_19:50:56.942551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:58.664001 run osmo-stp_10.42.42.5(pid=20948): stderr: | 20221212195057109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195057110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195057110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195057110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195057111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195057111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195057111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:58.808636 run patchelf(pid=20951): Terminating (SIGINT) 19:50:58.975603 run patchelf(pid=20951): Terminated: ok {rc=0} 19:50:59.096473 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20948): Process ended prematurely: osmo-stp_10.42.42.5(pid=20948) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20948)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 19:50:59.106235 tst iperf3.py:8: Test FAILED (7.6 sec) 19:50:59.133762 run osmo-hlr_10.42.42.2(pid=20945): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20945)] 19:50:59.181374 run osmo-hlr_10.42.42.2(pid=20945): stdout: | (launched: 2022-12-12_19:50:55.880830) 19:50:59.230611 run osmo-hlr_10.42.42.2(pid=20945): stderr: | 20221212195056056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195056056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195056056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195056056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195056056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195056056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195056069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195056079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195056079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195056080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:59.280179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20940): Terminating (SIGTERM) 19:50:59.319763 run iperf3-srv_10.42.42.10(pid=20941): Terminating (SIGTERM) 19:50:59.359816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20944): Terminating (SIGTERM) 19:50:59.399440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20947): Terminating (SIGTERM) 19:50:59.439301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20950): Terminating (SIGTERM) 19:50:59.478911 --- ParallelTerminationStrategy: PID 20940 died... 19:50:59.497988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20940): Terminated: ok {rc=0} 19:50:59.542462 --- ParallelTerminationStrategy: PID 20941 died... 19:50:59.561217 run iperf3-srv_10.42.42.10(pid=20941): Terminated {rc=256} 19:50:59.605180 --- ParallelTerminationStrategy: PID 20944 died... 19:50:59.623889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20944): Terminated: ok {rc=0} 19:50:59.668048 --- ParallelTerminationStrategy: PID 20947 died... 19:50:59.686703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20947): Terminated: ok {rc=0} 19:50:59.730467 --- ParallelTerminationStrategy: PID 20950 died... 19:50:59.749109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20950): Terminated: ok {rc=0} 19:50:59.833087 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:51:00.992465 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.006053 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:51:01.083734 tst iperf3m4.py: using LAC 31109 19:51:01.201766 tst iperf3m4.py: using RAC 254 19:51:01.356009 tst iperf3m4.py: using CellId 31109 19:51:01.515242 tst iperf3m4.py: using BVCI 31110 19:51:01.665354 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.677080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.688730 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.700619 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.712620 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.724702 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.736785 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.748767 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:01.761097 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:51:01.904607 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:51:02.045723 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:51:02.178986 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:51:02.323279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:51:02.526250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:02.826310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20952): Launched 19:51:03.088676 run iperf3-srv_10.42.42.10(pid=20953): Launched 19:51:03.201314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:51:03.401200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:03.701105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20954): Launched 19:51:03.962364 run iperf3-srv_10.42.42.10(pid=20955): Launched 19:51:04.076472 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:51:04.276400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:04.576112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20956): Launched 19:51:04.838232 run iperf3-srv_10.42.42.10(pid=20957): Launched 19:51:04.950116 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:51:05.147850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:05.447970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20958): Launched 19:51:05.709246 run iperf3-srv_10.42.42.10(pid=20959): Launched 19:51:05.821114 tst iperf3m4.py:8: start network... 19:51:06.018830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:06.482341 run create_hlr_db(pid=20960): Launched 19:51:06.605522 bus /gobi_6: Setting Powered False 19:51:07.665665 run create_hlr_db(pid=20960): Terminated: ok {rc=0} 19:51:08.102804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20962): Launched 19:51:08.424604 run osmo-hlr_10.42.42.2(pid=20963): Launched 19:51:08.547322 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:09.095252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20965): Launched 19:51:09.415660 run osmo-stp_10.42.42.5(pid=20966): Launched 19:51:09.538554 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:10.089503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20968): Launched 19:51:10.211840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:10.482523 run patchelf(pid=20969): Launched 19:51:10.660880 run osmo-stp_10.42.42.5(pid=20966): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20966)] 19:51:10.796916 run osmo-stp_10.42.42.5(pid=20966): stdout: | (launched: 2022-12-12_19:51:09.357058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:10.934262 run osmo-stp_10.42.42.5(pid=20966): stderr: | 20221212195109545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195109545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195109545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195109545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195109546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195109546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195109546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:11.071932 run osmo-stp_10.42.42.5(pid=20966): stdout: | (launched: 2022-12-12_19:51:09.357058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:11.203570 run osmo-stp_10.42.42.5(pid=20966): stderr: | 20221212195109545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195109545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195109545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195109545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195109546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195109546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195109546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:11.359879 run patchelf(pid=20969): Terminating (SIGINT) 19:51:11.539053 run patchelf(pid=20969): Terminated: ok {rc=0} 19:51:11.668265 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20966): Process ended prematurely: osmo-stp_10.42.42.5(pid=20966) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20966)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:51:11.678659 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:51:11.708419 run osmo-hlr_10.42.42.2(pid=20963): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20963)] 19:51:11.759859 run osmo-hlr_10.42.42.2(pid=20963): stdout: | (launched: 2022-12-12_19:51:08.365819) 19:51:11.813194 run osmo-hlr_10.42.42.2(pid=20963): stderr: | 20221212195108561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195108561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195108561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195108561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195108561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195108561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195108574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195108582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195108582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195108582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:11.866839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20952): Terminating (SIGTERM) 19:51:11.909684 run iperf3-srv_10.42.42.10(pid=20953): Terminating (SIGTERM) 19:51:11.952396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20954): Terminating (SIGTERM) 19:51:11.995069 run iperf3-srv_10.42.42.10(pid=20955): Terminating (SIGTERM) 19:51:12.037467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20956): Terminating (SIGTERM) 19:51:12.079934 run iperf3-srv_10.42.42.10(pid=20957): Terminating (SIGTERM) 19:51:12.122363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20958): Terminating (SIGTERM) 19:51:12.164743 run iperf3-srv_10.42.42.10(pid=20959): Terminating (SIGTERM) 19:51:12.207212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20962): Terminating (SIGTERM) 19:51:12.249837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20965): Terminating (SIGTERM) 19:51:12.292167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20968): Terminating (SIGTERM) 19:51:12.334888 --- ParallelTerminationStrategy: PID 20952 died... 19:51:12.355284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20952): Terminated: ok {rc=0} 19:51:12.402359 --- ParallelTerminationStrategy: PID 20953 died... 19:51:12.421927 run iperf3-srv_10.42.42.10(pid=20953): Terminated {rc=256} 19:51:12.468533 --- ParallelTerminationStrategy: PID 20954 died... 19:51:12.488154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20954): Terminated: ok {rc=0} 19:51:12.535386 --- ParallelTerminationStrategy: PID 20955 died... 19:51:12.554937 run iperf3-srv_10.42.42.10(pid=20955): Terminated {rc=256} 19:51:12.601431 --- ParallelTerminationStrategy: PID 20956 died... 19:51:12.620757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20956): Terminated: ok {rc=0} 19:51:12.667608 --- ParallelTerminationStrategy: PID 20957 died... 19:51:12.687088 run iperf3-srv_10.42.42.10(pid=20957): Terminated {rc=256} 19:51:12.733862 --- ParallelTerminationStrategy: PID 20958 died... 19:51:12.753453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20958): Terminated: ok {rc=0} 19:51:12.799892 --- ParallelTerminationStrategy: PID 20959 died... 19:51:12.819441 run iperf3-srv_10.42.42.10(pid=20959): Terminated {rc=256} 19:51:12.866002 --- ParallelTerminationStrategy: PID 20962 died... 19:51:12.885698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20962): Terminated: ok {rc=0} 19:51:12.932121 --- ParallelTerminationStrategy: PID 20965 died... 19:51:12.951800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20965): Terminated: ok {rc=0} 19:51:12.998396 --- ParallelTerminationStrategy: PID 20968 died... 19:51:13.018203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20968): Terminated: ok {rc=0} 19:51:13.106860 bus /gobi_4: Setting Powered False 19:51:14.207124 bus /gobi_4: Setting Powered False 19:51:15.324756 bus /gobi_1: Setting Powered False 19:51:16.421717 bus /gobi_1: Setting Powered False 19:51:17.536492 bus /gobi_0: Setting Powered False 19:51:18.630829 bus /gobi_0: Setting Powered False 19:51:19.745916 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:51:20.850779 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:20.862955 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:51:20.934374 tst ping.py: using LAC 31110 19:51:21.061774 tst ping.py: using RAC 255 19:51:21.177298 tst ping.py: using CellId 31110 19:51:21.292828 tst ping.py: using BVCI 31111 19:51:21.399267 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:21.410398 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:21.421230 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:21.432382 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:21.443654 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:21.455073 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:21.466503 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:21.477732 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:51:21.596405 tst ping.py:19: start network... 19:51:21.808323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:22.297639 run create_hlr_db(pid=20971): Launched 19:51:22.419978 bus /gobi_6: Setting Powered False 19:51:23.483241 run create_hlr_db(pid=20971): Terminated: ok {rc=0} 19:51:23.906316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20973): Launched 19:51:24.199798 run osmo-hlr_10.42.42.2(pid=20974): Launched 19:51:24.311144 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:24.817591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20976): Launched 19:51:25.111636 run osmo-stp_10.42.42.5(pid=20977): Launched 19:51:25.223096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:25.731523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20979): Launched 19:51:25.843969 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:26.092506 run patchelf(pid=20980): Launched 19:51:26.255998 run osmo-stp_10.42.42.5(pid=20977): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20977)] 19:51:26.380341 run osmo-stp_10.42.42.5(pid=20977): stdout: | (launched: 2022-12-12_19:51:25.056784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:26.506513 run osmo-stp_10.42.42.5(pid=20977): stderr: | 20221212195125225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195125225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195125226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195125226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195125226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195125226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195125227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:26.632940 run osmo-stp_10.42.42.5(pid=20977): stdout: | (launched: 2022-12-12_19:51:25.056784) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:26.753251 run osmo-stp_10.42.42.5(pid=20977): stderr: | 20221212195125225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195125225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195125226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195125226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195125226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195125226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195125227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:26.896204 run patchelf(pid=20980): Terminating (SIGINT) 19:51:27.060791 run patchelf(pid=20980): Terminated: ok {rc=0} 19:51:27.179177 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20977): Process ended prematurely: osmo-stp_10.42.42.5(pid=20977) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20977)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 19:51:27.188032 tst ping.py:22: Test FAILED (6.3 sec) 19:51:27.214957 run osmo-hlr_10.42.42.2(pid=20974): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20974)] 19:51:27.262749 run osmo-hlr_10.42.42.2(pid=20974): stdout: | (launched: 2022-12-12_19:51:24.145601) 19:51:27.312239 run osmo-hlr_10.42.42.2(pid=20974): stderr: | 20221212195124318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195124318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195124318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195124318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195124318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195124318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195124330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195124339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195124339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195124339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:27.362329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20973): Terminating (SIGTERM) 19:51:27.402102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20976): Terminating (SIGTERM) 19:51:27.441800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20979): Terminating (SIGTERM) 19:51:27.481949 --- ParallelTerminationStrategy: PID 20973 died... 19:51:27.500922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20973): Terminated: ok {rc=0} 19:51:27.545313 --- ParallelTerminationStrategy: PID 20976 died... 19:51:27.564271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20976): Terminated: ok {rc=0} 19:51:27.608846 --- ParallelTerminationStrategy: PID 20979 died... 19:51:27.627955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20979): Terminated: ok {rc=0} 19:51:27.711710 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:51:28.795448 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:28.806989 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:51:28.879720 tst ping_idle_ping.py: using LAC 31111 19:51:28.995862 tst ping_idle_ping.py: using RAC 1 19:51:29.112204 tst ping_idle_ping.py: using CellId 31111 19:51:29.226472 tst ping_idle_ping.py: using BVCI 31112 19:51:29.334103 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:29.345075 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:29.355847 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:29.366633 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:29.377406 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:29.388108 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:29.398908 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:29.409595 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:51:29.524666 tst ping_idle_ping.py:24: start network... 19:51:29.721039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:30.174208 run create_hlr_db(pid=20981): Launched 19:51:30.295704 bus /gobi_6: Setting Powered False 19:51:31.353381 run create_hlr_db(pid=20981): Terminated: ok {rc=0} 19:51:31.776061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20983): Launched 19:51:32.089388 run osmo-hlr_10.42.42.2(pid=20984): Launched 19:51:32.272290 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:32.815009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20986): Launched 19:51:33.134286 run osmo-stp_10.42.42.5(pid=20987): Launched 19:51:33.254233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:33.800380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20989): Launched 19:51:33.921962 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:34.189768 run patchelf(pid=20990): Launched 19:51:34.366122 run osmo-stp_10.42.42.5(pid=20987): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20987)] 19:51:34.500295 run osmo-stp_10.42.42.5(pid=20987): stdout: | (launched: 2022-12-12_19:51:33.076090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:34.636302 run osmo-stp_10.42.42.5(pid=20987): stderr: | 20221212195133263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195133263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195133263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195133264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195133265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195133265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195133265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:34.772097 run osmo-stp_10.42.42.5(pid=20987): stdout: | (launched: 2022-12-12_19:51:33.076090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:34.902460 run osmo-stp_10.42.42.5(pid=20987): stderr: | 20221212195133263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195133263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195133263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195133264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195133265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195133265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195133265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:35.056179 run patchelf(pid=20990): Terminating (SIGINT) 19:51:35.233099 run patchelf(pid=20990): Terminated: ok {rc=0} 19:51:35.361074 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20987): Process ended prematurely: osmo-stp_10.42.42.5(pid=20987) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20987)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:51:35.370656 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:51:35.399552 run osmo-hlr_10.42.42.2(pid=20984): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20984)] 19:51:35.450127 run osmo-hlr_10.42.42.2(pid=20984): stdout: | (launched: 2022-12-12_19:51:32.034296) 19:51:35.502353 run osmo-hlr_10.42.42.2(pid=20984): stderr: | 20221212195132256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195132256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195132256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195132256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195132256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195132256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195132268 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195132277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195132277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195132277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:35.554950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20983): Terminating (SIGTERM) 19:51:35.597099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20986): Terminating (SIGTERM) 19:51:35.639277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20989): Terminating (SIGTERM) 19:51:35.681652 --- ParallelTerminationStrategy: PID 20983 died... 19:51:35.701850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20983): Terminated: ok {rc=0} 19:51:35.749401 --- ParallelTerminationStrategy: PID 20986 died... 19:51:35.769165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20986): Terminated: ok {rc=0} 19:51:35.816545 --- ParallelTerminationStrategy: PID 20989 died... 19:51:35.836284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20989): Terminated: ok {rc=0} 19:51:35.925585 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:51:37.231741 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:51:37.238412 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:51:37.273091 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:51:37.313256 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:51:37.402989 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:51:37.436886 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:51:37.476887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:51:38.071060 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:51:38.123583 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.135159 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:51:38.206933 tst cs_paging_gprs_active.py: using LAC 31112 19:51:38.333939 tst cs_paging_gprs_active.py: using RAC 2 19:51:38.461401 tst cs_paging_gprs_active.py: using CellId 31112 19:51:38.586125 tst cs_paging_gprs_active.py: using BVCI 31113 19:51:38.702631 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.714081 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.725352 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.737230 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.748919 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.760326 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.773000 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.785867 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:38.798098 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:51:38.915128 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:51:39.035014 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:51:39.238201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:39.541747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20996): Launched 19:51:39.806518 run iperf3-srv_10.42.42.10(pid=20997): Launched 19:51:39.921764 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:51:40.123238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:40.425839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20998): Launched 19:51:40.691030 run iperf3-srv_10.42.42.10(pid=20999): Launched 19:51:40.804142 tst cs_paging_gprs_active.py:38: start network... 19:51:41.005184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:41.471003 run create_hlr_db(pid=21000): Launched 19:51:41.595449 bus /gobi_6: Setting Powered False 19:51:42.655813 run create_hlr_db(pid=21000): Terminated: ok {rc=0} 19:51:43.098300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21002): Launched 19:51:43.422907 run osmo-hlr_10.42.42.2(pid=21003): Launched 19:51:43.546871 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:44.099589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21005): Launched 19:51:44.422682 run osmo-stp_10.42.42.5(pid=21006): Launched 19:51:44.547381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:45.103295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21008): Launched 19:51:45.227382 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:45.502919 run patchelf(pid=21009): Launched 19:51:45.682849 run osmo-stp_10.42.42.5(pid=21006): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21006)] 19:51:45.819583 run osmo-stp_10.42.42.5(pid=21006): stdout: | (launched: 2022-12-12_19:51:44.363592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:45.977846 run osmo-stp_10.42.42.5(pid=21006): stderr: | 20221212195144551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195144551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195144552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195144552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195144553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195144553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195144553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:46.118039 run osmo-stp_10.42.42.5(pid=21006): stdout: | (launched: 2022-12-12_19:51:44.363592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:46.251817 run osmo-stp_10.42.42.5(pid=21006): stderr: | 20221212195144551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195144551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195144552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195144552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195144553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195144553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195144553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:46.411633 run patchelf(pid=21009): Terminating (SIGINT) 19:51:46.595690 run patchelf(pid=21009): Terminated: ok {rc=0} 19:51:46.728791 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21006): Process ended prematurely: osmo-stp_10.42.42.5(pid=21006) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21006)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:51:46.739896 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:51:46.770649 run osmo-hlr_10.42.42.2(pid=21003): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21003)] 19:51:46.822668 run osmo-hlr_10.42.42.2(pid=21003): stdout: | (launched: 2022-12-12_19:51:43.363443) 19:51:46.876061 run osmo-hlr_10.42.42.2(pid=21003): stderr: | 20221212195143557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195143557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195143557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195143557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195143558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195143558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195143571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195143579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195143579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195143579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:46.929879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20996): Terminating (SIGTERM) 19:51:46.973181 run iperf3-srv_10.42.42.10(pid=20997): Terminating (SIGTERM) 19:51:47.018857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20998): Terminating (SIGTERM) 19:51:47.062611 run iperf3-srv_10.42.42.10(pid=20999): Terminating (SIGTERM) 19:51:47.108113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21002): Terminating (SIGTERM) 19:51:47.151305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21005): Terminating (SIGTERM) 19:51:47.194319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21008): Terminating (SIGTERM) 19:51:47.237969 --- ParallelTerminationStrategy: PID 20996 died... 19:51:47.258043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20996): Terminated: ok {rc=0} 19:51:47.305093 --- ParallelTerminationStrategy: PID 20997 died... 19:51:47.324720 run iperf3-srv_10.42.42.10(pid=20997): Terminated {rc=256} 19:51:47.371989 --- ParallelTerminationStrategy: PID 20998 died... 19:51:47.391667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20998): Terminated: ok {rc=0} 19:51:47.438819 --- ParallelTerminationStrategy: PID 20999 died... 19:51:47.458506 run iperf3-srv_10.42.42.10(pid=20999): Terminated {rc=256} 19:51:47.505534 --- ParallelTerminationStrategy: PID 21002 died... 19:51:47.525099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21002): Terminated: ok {rc=0} 19:51:47.572052 --- ParallelTerminationStrategy: PID 21005 died... 19:51:47.591865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21005): Terminated: ok {rc=0} 19:51:47.638850 --- ParallelTerminationStrategy: PID 21008 died... 19:51:47.658473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21008): Terminated: ok {rc=0} 19:51:47.747167 bus /gobi_0: Setting Powered False 19:51:48.847228 bus /gobi_0: Setting Powered False 19:51:49.963565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:51:51.113551 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.125874 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:51:51.197307 tst iperf3.py: using LAC 31113 19:51:51.323870 tst iperf3.py: using RAC 3 19:51:51.449709 tst iperf3.py: using CellId 31113 19:51:51.567282 tst iperf3.py: using BVCI 31114 19:51:51.675229 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.686245 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.697037 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.707830 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.718533 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.729393 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.740201 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.750912 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:51:51.762108 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:51:51.879675 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:51:52.096466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:52.419265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Launched 19:51:52.700186 run iperf3-srv_10.42.42.10(pid=21011): Launched 19:51:52.820916 tst iperf3.py:8: start network... 19:51:53.036391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:53.533034 run create_hlr_db(pid=21012): Launched 19:51:53.657802 bus /gobi_6: Setting Powered False 19:51:54.721030 run create_hlr_db(pid=21012): Terminated: ok {rc=0} 19:51:55.150604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Launched 19:51:55.451643 run osmo-hlr_10.42.42.2(pid=21015): Launched 19:51:55.566405 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:56.101419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Launched 19:51:56.401235 run osmo-stp_10.42.42.5(pid=21018): Launched 19:51:56.516459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:57.034010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21020): Launched 19:51:57.148794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:57.401677 run patchelf(pid=21021): Launched 19:51:57.568779 run osmo-stp_10.42.42.5(pid=21018): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] 19:51:57.695250 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-12_19:51:56.345788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:57.824103 run osmo-stp_10.42.42.5(pid=21018): stderr: | 20221212195156514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195156514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195156515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195156515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195156515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195156516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195156516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:57.953176 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-12_19:51:56.345788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:58.075118 run osmo-stp_10.42.42.5(pid=21018): stderr: | 20221212195156514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195156514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195156515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195156515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195156515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195156516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195156516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:58.220149 run patchelf(pid=21021): Terminating (SIGINT) 19:51:58.388042 run patchelf(pid=21021): Terminated: ok {rc=0} 19:51:58.508912 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 19:51:58.518348 tst iperf3.py:8: Test FAILED (7.4 sec) 19:51:58.545590 run osmo-hlr_10.42.42.2(pid=21015): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21015)] 19:51:58.593404 run osmo-hlr_10.42.42.2(pid=21015): stdout: | (launched: 2022-12-12_19:51:55.395739) 19:51:58.643010 run osmo-hlr_10.42.42.2(pid=21015): stderr: | 20221212195155568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195155569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195155569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195155569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195155569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195155569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195155581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195155592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195155592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195155592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:58.692941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Terminating (SIGTERM) 19:51:58.732478 run iperf3-srv_10.42.42.10(pid=21011): Terminating (SIGTERM) 19:51:58.772090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminating (SIGTERM) 19:51:58.811835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminating (SIGTERM) 19:51:58.851680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21020): Terminating (SIGTERM) 19:51:58.891619 --- ParallelTerminationStrategy: PID 21010 died... 19:51:58.910404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Terminated: ok {rc=0} 19:51:58.954633 --- ParallelTerminationStrategy: PID 21011 died... 19:51:58.973236 run iperf3-srv_10.42.42.10(pid=21011): Terminated {rc=256} 19:51:59.017187 --- ParallelTerminationStrategy: PID 21014 died... 19:51:59.035796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminated: ok {rc=0} 19:51:59.079611 --- ParallelTerminationStrategy: PID 21017 died... 19:51:59.098227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminated: ok {rc=0} 19:51:59.141906 --- ParallelTerminationStrategy: PID 21020 died... 19:51:59.160474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21020): Terminated: ok {rc=0} 19:51:59.243937 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:52:00.394205 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:00.406352 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:52:00.479713 tst iperf3m4.py: using LAC 31114 19:52:00.606711 tst iperf3m4.py: using RAC 4 19:52:00.731776 tst iperf3m4.py: using CellId 31114 19:52:00.863453 tst iperf3m4.py: using BVCI 31115 19:52:00.982803 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:00.995514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:01.007839 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:01.022220 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:01.035736 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:01.048316 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:01.063030 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:01.078001 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:01.090717 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:52:01.215972 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:52:01.374397 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:52:01.524850 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:52:01.653084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:52:01.862879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:52:02.193295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21022): Launched 19:52:02.487234 run iperf3-srv_10.42.42.10(pid=21023): Launched 19:52:02.608329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:52:02.824487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:52:03.147104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21024): Launched 19:52:03.430057 run iperf3-srv_10.42.42.10(pid=21025): Launched 19:52:03.550782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:52:03.766990 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:52:04.090486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21026): Launched 19:52:04.370817 run iperf3-srv_10.42.42.10(pid=21027): Launched 19:52:04.491801 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:52:04.707560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:52:05.029642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21028): Launched 19:52:05.309751 run iperf3-srv_10.42.42.10(pid=21029): Launched 19:52:05.432378 tst iperf3m4.py:8: start network... 19:52:05.647185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:06.143233 run create_hlr_db(pid=21030): Launched 19:52:06.265335 bus /gobi_6: Setting Powered False 19:52:07.328570 run create_hlr_db(pid=21030): Terminated: ok {rc=0} 19:52:07.777641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Launched 19:52:08.098761 run osmo-hlr_10.42.42.2(pid=21033): Launched 19:52:08.221314 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:08.771765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Launched 19:52:09.095336 run osmo-stp_10.42.42.5(pid=21036): Launched 19:52:09.219206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:52:09.773675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Launched 19:52:09.897217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:10.169518 run patchelf(pid=21039): Launched 19:52:10.349061 run osmo-stp_10.42.42.5(pid=21036): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] 19:52:10.485633 run osmo-stp_10.42.42.5(pid=21036): stdout: | (launched: 2022-12-12_19:52:09.036392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:10.623678 run osmo-stp_10.42.42.5(pid=21036): stderr: | 20221212195209223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195209223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195209224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195209224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195209225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195209225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195209225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:10.761602 run osmo-stp_10.42.42.5(pid=21036): stdout: | (launched: 2022-12-12_19:52:09.036392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:10.893229 run osmo-stp_10.42.42.5(pid=21036): stderr: | 20221212195209223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195209223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195209224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195209224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195209225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195209225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195209225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:11.048750 run patchelf(pid=21039): Terminating (SIGINT) 19:52:11.228427 run patchelf(pid=21039): Terminated: ok {rc=0} 19:52:11.358198 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21036): Process ended prematurely: osmo-stp_10.42.42.5(pid=21036) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:52:11.368705 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:52:11.398407 run osmo-hlr_10.42.42.2(pid=21033): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21033)] 19:52:11.449122 run osmo-hlr_10.42.42.2(pid=21033): stdout: | (launched: 2022-12-12_19:52:08.039556) 19:52:11.501720 run osmo-hlr_10.42.42.2(pid=21033): stderr: | 20221212195208233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195208233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195208233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195208233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195208233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195208233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195208246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195208254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195208254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195208254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:11.554649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21022): Terminating (SIGTERM) 19:52:11.596906 run iperf3-srv_10.42.42.10(pid=21023): Terminating (SIGTERM) 19:52:11.639062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21024): Terminating (SIGTERM) 19:52:11.681032 run iperf3-srv_10.42.42.10(pid=21025): Terminating (SIGTERM) 19:52:11.722879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21026): Terminating (SIGTERM) 19:52:11.764831 run iperf3-srv_10.42.42.10(pid=21027): Terminating (SIGTERM) 19:52:11.806669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21028): Terminating (SIGTERM) 19:52:11.849022 run iperf3-srv_10.42.42.10(pid=21029): Terminating (SIGTERM) 19:52:11.890873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Terminating (SIGTERM) 19:52:11.933048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Terminating (SIGTERM) 19:52:11.975085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Terminating (SIGTERM) 19:52:12.017286 --- ParallelTerminationStrategy: PID 21022 died... 19:52:12.037400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21022): Terminated: ok {rc=0} 19:52:12.084767 --- ParallelTerminationStrategy: PID 21023 died... 19:52:12.104526 run iperf3-srv_10.42.42.10(pid=21023): Terminated {rc=256} 19:52:12.151215 --- ParallelTerminationStrategy: PID 21024 died... 19:52:12.171833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21024): Terminated: ok {rc=0} 19:52:12.223765 --- ParallelTerminationStrategy: PID 21025 died... 19:52:12.243388 run iperf3-srv_10.42.42.10(pid=21025): Terminated {rc=256} 19:52:12.290320 --- ParallelTerminationStrategy: PID 21026 died... 19:52:12.309831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21026): Terminated: ok {rc=0} 19:52:12.356588 --- ParallelTerminationStrategy: PID 21027 died... 19:52:12.376375 run iperf3-srv_10.42.42.10(pid=21027): Terminated {rc=256} 19:52:12.423148 --- ParallelTerminationStrategy: PID 21028 died... 19:52:12.442689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21028): Terminated: ok {rc=0} 19:52:12.489330 --- ParallelTerminationStrategy: PID 21029 died... 19:52:12.508891 run iperf3-srv_10.42.42.10(pid=21029): Terminated {rc=256} 19:52:12.555536 --- ParallelTerminationStrategy: PID 21032 died... 19:52:12.575065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21032): Terminated: ok {rc=0} 19:52:12.622013 --- ParallelTerminationStrategy: PID 21035 died... 19:52:12.641542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21035): Terminated: ok {rc=0} 19:52:12.688771 --- ParallelTerminationStrategy: PID 21038 died... 19:52:12.708370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21038): Terminated: ok {rc=0} 19:52:12.796865 bus /gobi_4: Setting Powered False 19:52:13.897454 bus /gobi_4: Setting Powered False 19:52:15.015171 bus /gobi_1: Setting Powered False 19:52:16.110422 bus /gobi_1: Setting Powered False 19:52:17.230241 bus /gobi_0: Setting Powered False 19:52:18.329674 bus /gobi_0: Setting Powered False 19:52:19.447041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:52:20.551904 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:20.563751 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:52:20.633686 tst ping.py: using LAC 31115 19:52:20.757386 tst ping.py: using RAC 5 19:52:20.881751 tst ping.py: using CellId 31115 19:52:21.000197 tst ping.py: using BVCI 31116 19:52:21.107277 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:21.118335 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:21.129267 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:21.139962 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:21.150845 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:21.161574 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:21.172258 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:21.182922 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:52:21.298288 tst ping.py:19: start network... 19:52:21.511270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:22.001607 run create_hlr_db(pid=21050): Launched 19:52:22.124698 bus /gobi_6: Setting Powered False 19:52:23.187763 run create_hlr_db(pid=21050): Terminated: ok {rc=0} 19:52:23.610715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21052): Launched 19:52:23.907085 run osmo-hlr_10.42.42.2(pid=21053): Launched 19:52:24.019657 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:24.526411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21055): Launched 19:52:24.820507 run osmo-stp_10.42.42.5(pid=21056): Launched 19:52:24.932608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:52:25.437730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21058): Launched 19:52:25.550211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:25.798377 run patchelf(pid=21059): Launched 19:52:25.963681 run osmo-stp_10.42.42.5(pid=21056): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21056)] 19:52:26.089523 run osmo-stp_10.42.42.5(pid=21056): stdout: | (launched: 2022-12-12_19:52:24.765846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:26.216340 run osmo-stp_10.42.42.5(pid=21056): stderr: | 20221212195224932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195224932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195224932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195224933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195224933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195224933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195224933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:26.343191 run osmo-stp_10.42.42.5(pid=21056): stdout: | (launched: 2022-12-12_19:52:24.765846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:26.464070 run osmo-stp_10.42.42.5(pid=21056): stderr: | 20221212195224932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195224932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195224932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195224933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195224933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195224933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195224933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:26.607088 run patchelf(pid=21059): Terminating (SIGINT) 19:52:26.772415 run patchelf(pid=21059): Terminated: ok {rc=0} 19:52:26.890965 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21056): Process ended prematurely: osmo-stp_10.42.42.5(pid=21056) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21056)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 19:52:26.899753 tst ping.py:22: Test FAILED (6.3 sec) 19:52:26.926750 run osmo-hlr_10.42.42.2(pid=21053): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21053)] 19:52:26.974523 run osmo-hlr_10.42.42.2(pid=21053): stdout: | (launched: 2022-12-12_19:52:23.852674) 19:52:27.023801 run osmo-hlr_10.42.42.2(pid=21053): stderr: | 20221212195224028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195224028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195224028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195224028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195224028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195224028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195224040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195224049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195224049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195224049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:27.073812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21052): Terminating (SIGTERM) 19:52:27.113662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21055): Terminating (SIGTERM) 19:52:27.153570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21058): Terminating (SIGTERM) 19:52:27.193641 --- ParallelTerminationStrategy: PID 21052 died... 19:52:27.212924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21052): Terminated: ok {rc=0} 19:52:27.257215 --- ParallelTerminationStrategy: PID 21055 died... 19:52:27.275918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21055): Terminated: ok {rc=0} 19:52:27.319822 --- ParallelTerminationStrategy: PID 21058 died... 19:52:27.338547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21058): Terminated: ok {rc=0} 19:52:27.423545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:52:28.508263 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:28.520021 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:52:28.593369 tst ping_idle_ping.py: using LAC 31116 19:52:28.718601 tst ping_idle_ping.py: using RAC 6 19:52:28.843389 tst ping_idle_ping.py: using CellId 31116 19:52:28.968492 tst ping_idle_ping.py: using BVCI 31117 19:52:29.085543 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:29.097472 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:29.108728 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:29.120842 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:29.132763 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:29.144870 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:29.156939 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:52:29.169036 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:52:29.286655 tst ping_idle_ping.py:24: start network... 19:52:29.483663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:29.939183 run create_hlr_db(pid=21060): Launched 19:52:30.060185 bus /gobi_6: Setting Powered False 19:52:31.134920 run create_hlr_db(pid=21060): Terminated: ok {rc=0} 19:52:31.621495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21062): Launched 19:52:31.935608 run osmo-hlr_10.42.42.2(pid=21063): Launched 19:52:32.136552 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:32.673660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21065): Launched 19:52:32.970126 run osmo-stp_10.42.42.5(pid=21066): Launched 19:52:33.081406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:52:33.590667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21068): Launched 19:52:33.703277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:33.952376 run patchelf(pid=21069): Launched 19:52:34.117859 run osmo-stp_10.42.42.5(pid=21066): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21066)] 19:52:34.242993 run osmo-stp_10.42.42.5(pid=21066): stdout: | (launched: 2022-12-12_19:52:32.914609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:34.370491 run osmo-stp_10.42.42.5(pid=21066): stderr: | 20221212195233082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195233082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195233083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195233083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195233083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195233084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195233084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:34.497670 run osmo-stp_10.42.42.5(pid=21066): stdout: | (launched: 2022-12-12_19:52:32.914609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:34.618589 run osmo-stp_10.42.42.5(pid=21066): stderr: | 20221212195233082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195233082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195233083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195233083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195233083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195233084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195233084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:34.762256 run patchelf(pid=21069): Terminating (SIGINT) 19:52:34.927412 run patchelf(pid=21069): Terminated: ok {rc=0} 19:52:35.046001 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21066): Process ended prematurely: osmo-stp_10.42.42.5(pid=21066) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21066)] [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:52:35.054932 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:52:35.081903 run osmo-hlr_10.42.42.2(pid=21063): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21063)] 19:52:35.129699 run osmo-hlr_10.42.42.2(pid=21063): stdout: | (launched: 2022-12-12_19:52:31.879231) 19:52:35.179256 run osmo-hlr_10.42.42.2(pid=21063): stderr: | 20221212195232218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195232218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195232218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195232218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195232218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195232218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195232231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195232239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195232240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195232240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:35.229370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21062): Terminating (SIGTERM) 19:52:35.269075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21065): Terminating (SIGTERM) 19:52:35.308691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21068): Terminating (SIGTERM) 19:52:35.348721 --- ParallelTerminationStrategy: PID 21062 died... 19:52:35.367940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21062): Terminated: ok {rc=0} 19:52:35.412268 --- ParallelTerminationStrategy: PID 21065 died... 19:52:35.430902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21065): Terminated: ok {rc=0} 19:52:35.475476 --- ParallelTerminationStrategy: PID 21068 died... 19:52:35.494205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21068): Terminated: ok {rc=0} 19:52:35.581445 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:52:36.888353 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:52:36.896832 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:52:36.931834 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:52:36.971705 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:52:37.061651 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:52:37.095240 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:52:37.135387 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:52:37.742090 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:52:37.794667 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:37.806723 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:52:37.859691 tst cs_paging_gprs_active.py: using LAC 31117 19:52:37.986838 tst cs_paging_gprs_active.py: using RAC 7 19:52:38.109361 tst cs_paging_gprs_active.py: using CellId 31117 19:52:38.227877 tst cs_paging_gprs_active.py: using BVCI 31118 19:52:38.336090 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.347382 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.358518 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.369716 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.380814 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.391940 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.403121 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.414202 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:38.425512 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:52:38.542269 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:52:38.657651 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:52:38.859041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:52:39.161808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21073): Launched 19:52:39.424342 run iperf3-srv_10.42.42.10(pid=21074): Launched 19:52:39.537253 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:52:39.737475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:52:40.039100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21075): Launched 19:52:40.302882 run iperf3-srv_10.42.42.10(pid=21076): Launched 19:52:40.415652 tst cs_paging_gprs_active.py:38: start network... 19:52:40.615780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:41.081115 run create_hlr_db(pid=21077): Launched 19:52:41.204768 bus /gobi_6: Setting Powered False 19:52:42.265584 run create_hlr_db(pid=21077): Terminated: ok {rc=0} 19:52:42.708437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21079): Launched 19:52:43.032440 run osmo-hlr_10.42.42.2(pid=21080): Launched 19:52:43.155732 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:43.713131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21082): Launched 19:52:44.035676 run osmo-stp_10.42.42.5(pid=21083): Launched 19:52:44.158699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:52:44.713844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21085): Launched 19:52:44.839035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:45.111330 run patchelf(pid=21086): Launched 19:52:45.292178 run osmo-stp_10.42.42.5(pid=21083): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21083)] 19:52:45.429393 run osmo-stp_10.42.42.5(pid=21083): stdout: | (launched: 2022-12-12_19:52:43.976166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:45.567846 run osmo-stp_10.42.42.5(pid=21083): stderr: | 20221212195244164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195244164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195244164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195244164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195244165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195244165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195244165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:45.706329 run osmo-stp_10.42.42.5(pid=21083): stdout: | (launched: 2022-12-12_19:52:43.976166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:45.847470 run osmo-stp_10.42.42.5(pid=21083): stderr: | 20221212195244164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195244164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195244164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195244164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195244165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195244165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195244165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:46.008650 run patchelf(pid=21086): Terminating (SIGINT) 19:52:46.181539 run patchelf(pid=21086): Terminated: ok {rc=0} 19:52:46.308456 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21083): Process ended prematurely: osmo-stp_10.42.42.5(pid=21083) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21083)] [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:52:46.318801 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:52:46.347365 run osmo-hlr_10.42.42.2(pid=21080): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21080)] 19:52:46.397894 run osmo-hlr_10.42.42.2(pid=21080): stdout: | (launched: 2022-12-12_19:52:42.972686) 19:52:46.449229 run osmo-hlr_10.42.42.2(pid=21080): stderr: | 20221212195243168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195243168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195243168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195243168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195243168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195243168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195243184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195243195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195243195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195243195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:46.501278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21073): Terminating (SIGTERM) 19:52:46.543005 run iperf3-srv_10.42.42.10(pid=21074): Terminating (SIGTERM) 19:52:46.586735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21075): Terminating (SIGTERM) 19:52:46.628504 run iperf3-srv_10.42.42.10(pid=21076): Terminating (SIGTERM) 19:52:46.670598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21079): Terminating (SIGTERM) 19:52:46.713118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21082): Terminating (SIGTERM) 19:52:46.756884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21085): Terminating (SIGTERM) 19:52:46.802554 --- ParallelTerminationStrategy: PID 21073 died... 19:52:46.822533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21073): Terminated: ok {rc=0} 19:52:46.870478 --- ParallelTerminationStrategy: PID 21074 died... 19:52:46.891831 run iperf3-srv_10.42.42.10(pid=21074): Terminated {rc=256} 19:52:46.939020 --- ParallelTerminationStrategy: PID 21075 died... 19:52:46.958885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21075): Terminated: ok {rc=0} 19:52:47.005223 --- ParallelTerminationStrategy: PID 21076 died... 19:52:47.024478 run iperf3-srv_10.42.42.10(pid=21076): Terminated {rc=256} 19:52:47.070189 --- ParallelTerminationStrategy: PID 21079 died... 19:52:47.090298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21079): Terminated: ok {rc=0} 19:52:47.135414 --- ParallelTerminationStrategy: PID 21082 died... 19:52:47.154668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21082): Terminated: ok {rc=0} 19:52:47.201079 --- ParallelTerminationStrategy: PID 21085 died... 19:52:47.220282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21085): Terminated: ok {rc=0} 19:52:47.304574 bus /gobi_0: Setting Powered False 19:52:48.403153 bus /gobi_0: Setting Powered False 19:52:49.521022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:52:50.668232 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:50.680188 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:52:50.735873 tst iperf3.py: using LAC 31118 19:52:50.855418 tst iperf3.py: using RAC 8 19:52:50.975072 tst iperf3.py: using CellId 31118 19:52:51.095913 tst iperf3.py: using BVCI 31119 19:52:51.206294 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.217707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.228709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.240318 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.251936 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.263552 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.275186 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.286748 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:51.298495 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:52:51.419324 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:52:51.636237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:52:51.959863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21087): Launched 19:52:52.241315 run iperf3-srv_10.42.42.10(pid=21088): Launched 19:52:52.362278 tst iperf3.py:8: start network... 19:52:52.579487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:53.077221 run create_hlr_db(pid=21089): Launched 19:52:53.202359 bus /gobi_6: Setting Powered False 19:52:54.266459 run create_hlr_db(pid=21089): Terminated: ok {rc=0} 19:52:54.698051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21091): Launched 19:52:54.998034 run osmo-hlr_10.42.42.2(pid=21092): Launched 19:52:55.112587 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:55.645260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21094): Launched 19:52:55.945757 run osmo-stp_10.42.42.5(pid=21095): Launched 19:52:56.060516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:52:56.578692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21097): Launched 19:52:56.693614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:56.946931 run patchelf(pid=21098): Launched 19:52:57.114432 run osmo-stp_10.42.42.5(pid=21095): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21095)] 19:52:57.241746 run osmo-stp_10.42.42.5(pid=21095): stdout: | (launched: 2022-12-12_19:52:55.889639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:57.370890 run osmo-stp_10.42.42.5(pid=21095): stderr: | 20221212195256057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195256057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195256057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195256057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195256058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195256058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195256058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:57.500485 run osmo-stp_10.42.42.5(pid=21095): stdout: | (launched: 2022-12-12_19:52:55.889639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:57.623475 run osmo-stp_10.42.42.5(pid=21095): stderr: | 20221212195256057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195256057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195256057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195256057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195256058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195256058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195256058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:57.768901 run patchelf(pid=21098): Terminating (SIGINT) 19:52:57.938021 run patchelf(pid=21098): Terminated: ok {rc=0} 19:52:58.059822 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21095): Process ended prematurely: osmo-stp_10.42.42.5(pid=21095) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21095)] [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:52:58.069353 tst iperf3.py:8: Test FAILED (7.4 sec) 19:52:58.096651 run osmo-hlr_10.42.42.2(pid=21092): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21092)] 19:52:58.144516 run osmo-hlr_10.42.42.2(pid=21092): stdout: | (launched: 2022-12-12_19:52:54.942410) 19:52:58.194111 run osmo-hlr_10.42.42.2(pid=21092): stderr: | 20221212195255115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195255115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195255115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195255115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195255115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195255115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195255128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195255138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195255138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195255138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:58.244430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21087): Terminating (SIGTERM) 19:52:58.284498 run iperf3-srv_10.42.42.10(pid=21088): Terminating (SIGTERM) 19:52:58.324415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21091): Terminating (SIGTERM) 19:52:58.364276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21094): Terminating (SIGTERM) 19:52:58.404156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21097): Terminating (SIGTERM) 19:52:58.444107 --- ParallelTerminationStrategy: PID 21087 died... 19:52:58.463201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21087): Terminated: ok {rc=0} 19:52:58.506921 --- ParallelTerminationStrategy: PID 21088 died... 19:52:58.525352 run iperf3-srv_10.42.42.10(pid=21088): Terminated {rc=256} 19:52:58.569077 --- ParallelTerminationStrategy: PID 21091 died... 19:52:58.587539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21091): Terminated: ok {rc=0} 19:52:58.631247 --- ParallelTerminationStrategy: PID 21094 died... 19:52:58.649761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21094): Terminated: ok {rc=0} 19:52:58.693318 --- ParallelTerminationStrategy: PID 21097 died... 19:52:58.711837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21097): Terminated: ok {rc=0} 19:52:58.795805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:52:59.944600 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:59.957280 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:53:00.012260 tst iperf3m4.py: using LAC 31119 19:53:00.141883 tst iperf3m4.py: using RAC 9 19:53:00.266458 tst iperf3m4.py: using CellId 31119 19:53:00.391838 tst iperf3m4.py: using BVCI 31120 19:53:00.509040 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.521141 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.533154 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.545237 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.557389 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.569525 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.581807 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.594149 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:00.606441 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:53:00.726952 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:53:00.845838 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:53:00.984345 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:53:01.125020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:53:01.365626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:53:01.697717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21099): Launched 19:53:01.988178 run iperf3-srv_10.42.42.10(pid=21100): Launched 19:53:02.126310 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:53:02.351114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:53:02.675302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21101): Launched 19:53:02.957742 run iperf3-srv_10.42.42.10(pid=21102): Launched 19:53:03.080193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:53:03.296400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:53:03.619756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21103): Launched 19:53:03.900268 run iperf3-srv_10.42.42.10(pid=21104): Launched 19:53:04.021331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:53:04.236931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:53:04.560360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21105): Launched 19:53:04.841328 run iperf3-srv_10.42.42.10(pid=21106): Launched 19:53:04.961826 tst iperf3m4.py:8: start network... 19:53:05.178297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:05.675280 run create_hlr_db(pid=21107): Launched 19:53:05.797965 bus /gobi_6: Setting Powered False 19:53:06.861986 run create_hlr_db(pid=21107): Terminated: ok {rc=0} 19:53:07.291285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Launched 19:53:07.591849 run osmo-hlr_10.42.42.2(pid=21110): Launched 19:53:07.708233 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:08.226278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Launched 19:53:08.527010 run osmo-stp_10.42.42.5(pid=21113): Launched 19:53:08.640369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:53:09.155378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Launched 19:53:09.270300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:53:09.524516 run patchelf(pid=21116): Launched 19:53:09.692350 run osmo-stp_10.42.42.5(pid=21113): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] 19:53:09.819957 run osmo-stp_10.42.42.5(pid=21113): stdout: | (launched: 2022-12-12_19:53:08.471548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:09.949381 run osmo-stp_10.42.42.5(pid=21113): stderr: | 20221212195308639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195308639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195308639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195308639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195308640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195308640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195308640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:10.078475 run osmo-stp_10.42.42.5(pid=21113): stdout: | (launched: 2022-12-12_19:53:08.471548) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:10.201699 run osmo-stp_10.42.42.5(pid=21113): stderr: | 20221212195308639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195308639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195308639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195308639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195308640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195308640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195308640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:10.347448 run patchelf(pid=21116): Terminating (SIGINT) 19:53:10.516250 run patchelf(pid=21116): Terminated: ok {rc=0} 19:53:10.637522 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21113): Process ended prematurely: osmo-stp_10.42.42.5(pid=21113) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:53:10.646927 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:53:10.674614 run osmo-hlr_10.42.42.2(pid=21110): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21110)] 19:53:10.722429 run osmo-hlr_10.42.42.2(pid=21110): stdout: | (launched: 2022-12-12_19:53:07.536324) 19:53:10.771881 run osmo-hlr_10.42.42.2(pid=21110): stderr: | 20221212195307710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195307710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195307710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195307710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195307710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195307710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195307723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195307734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195307734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195307734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:10.821711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21099): Terminating (SIGTERM) 19:53:10.861568 run iperf3-srv_10.42.42.10(pid=21100): Terminating (SIGTERM) 19:53:10.901222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21101): Terminating (SIGTERM) 19:53:10.940486 run iperf3-srv_10.42.42.10(pid=21102): Terminating (SIGTERM) 19:53:10.979941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21103): Terminating (SIGTERM) 19:53:11.019443 run iperf3-srv_10.42.42.10(pid=21104): Terminating (SIGTERM) 19:53:11.058812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21105): Terminating (SIGTERM) 19:53:11.098262 run iperf3-srv_10.42.42.10(pid=21106): Terminating (SIGTERM) 19:53:11.137779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Terminating (SIGTERM) 19:53:11.177998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Terminating (SIGTERM) 19:53:11.217868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Terminating (SIGTERM) 19:53:11.257653 --- ParallelTerminationStrategy: PID 21099 died... 19:53:11.276797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21099): Terminated: ok {rc=0} 19:53:11.321105 --- ParallelTerminationStrategy: PID 21100 died... 19:53:11.339716 run iperf3-srv_10.42.42.10(pid=21100): Terminated {rc=256} 19:53:11.384013 --- ParallelTerminationStrategy: PID 21101 died... 19:53:11.402656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21101): Terminated: ok {rc=0} 19:53:11.446322 --- ParallelTerminationStrategy: PID 21102 died... 19:53:11.464837 run iperf3-srv_10.42.42.10(pid=21102): Terminated {rc=256} 19:53:11.508403 --- ParallelTerminationStrategy: PID 21103 died... 19:53:11.527179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21103): Terminated: ok {rc=0} 19:53:11.570816 --- ParallelTerminationStrategy: PID 21104 died... 19:53:11.589371 run iperf3-srv_10.42.42.10(pid=21104): Terminated {rc=256} 19:53:11.632650 --- ParallelTerminationStrategy: PID 21105 died... 19:53:11.651311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21105): Terminated: ok {rc=0} 19:53:11.694881 --- ParallelTerminationStrategy: PID 21106 died... 19:53:11.713349 run iperf3-srv_10.42.42.10(pid=21106): Terminated {rc=256} 19:53:11.757307 --- ParallelTerminationStrategy: PID 21109 died... 19:53:11.775981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21109): Terminated: ok {rc=0} 19:53:11.819807 --- ParallelTerminationStrategy: PID 21112 died... 19:53:11.838325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21112): Terminated: ok {rc=0} 19:53:11.882027 --- ParallelTerminationStrategy: PID 21115 died... 19:53:11.900579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21115): Terminated: ok {rc=0} 19:53:11.984298 bus /gobi_4: Setting Powered False 19:53:13.082374 bus /gobi_4: Setting Powered False 19:53:14.201164 bus /gobi_1: Setting Powered False 19:53:15.300373 bus /gobi_1: Setting Powered False 19:53:16.411991 bus /gobi_0: Setting Powered False 19:53:17.509074 bus /gobi_0: Setting Powered False 19:53:18.623352 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:53:19.726282 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:19.739047 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:53:19.794250 tst ping.py: using LAC 31120 19:53:19.916862 tst ping.py: using RAC 10 19:53:20.041571 tst ping.py: using CellId 31120 19:53:20.156815 tst ping.py: using BVCI 31121 19:53:20.263490 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:20.274803 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:20.286167 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:20.297471 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:20.308627 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:20.319775 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:20.330965 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:20.342031 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:53:20.459844 tst ping.py:19: start network... 19:53:20.671740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:21.157461 run create_hlr_db(pid=21117): Launched 19:53:21.279174 bus /gobi_6: Setting Powered False 19:53:22.341578 run create_hlr_db(pid=21117): Terminated: ok {rc=0} 19:53:22.765194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21119): Launched 19:53:23.060174 run osmo-hlr_10.42.42.2(pid=21120): Launched 19:53:23.173591 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:23.683338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21122): Launched 19:53:23.978305 run osmo-stp_10.42.42.5(pid=21123): Launched 19:53:24.090467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:53:24.599079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21125): Launched 19:53:24.711888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:53:24.961553 run patchelf(pid=21126): Launched 19:53:25.128235 run osmo-stp_10.42.42.5(pid=21123): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21123)] 19:53:25.253525 run osmo-stp_10.42.42.5(pid=21123): stdout: | (launched: 2022-12-12_19:53:23.923377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:25.380445 run osmo-stp_10.42.42.5(pid=21123): stderr: | 20221212195324090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195324090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195324090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195324091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195324091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195324091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195324091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:25.507154 run osmo-stp_10.42.42.5(pid=21123): stdout: | (launched: 2022-12-12_19:53:23.923377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:25.627921 run osmo-stp_10.42.42.5(pid=21123): stderr: | 20221212195324090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195324090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195324090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195324091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195324091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195324091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195324091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:25.770804 run patchelf(pid=21126): Terminating (SIGINT) 19:53:25.935761 run patchelf(pid=21126): Terminated: ok {rc=0} 19:53:26.054134 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21123): Process ended prematurely: osmo-stp_10.42.42.5(pid=21123) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21123)] [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:53:26.062904 tst ping.py:22: Test FAILED (6.3 sec) 19:53:26.089591 run osmo-hlr_10.42.42.2(pid=21120): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21120)] 19:53:26.137297 run osmo-hlr_10.42.42.2(pid=21120): stdout: | (launched: 2022-12-12_19:53:23.005863) 19:53:26.186878 run osmo-hlr_10.42.42.2(pid=21120): stderr: | 20221212195323176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195323176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195323176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195323177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195323177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195323177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195323191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195323200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195323201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195323201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:26.236774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21119): Terminating (SIGTERM) 19:53:26.276815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21122): Terminating (SIGTERM) 19:53:26.316873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21125): Terminating (SIGTERM) 19:53:26.356722 --- ParallelTerminationStrategy: PID 21119 died... 19:53:26.375903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21119): Terminated: ok {rc=0} 19:53:26.420182 --- ParallelTerminationStrategy: PID 21122 died... 19:53:26.438829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21122): Terminated: ok {rc=0} 19:53:26.482803 --- ParallelTerminationStrategy: PID 21125 died... 19:53:26.501596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21125): Terminated: ok {rc=0} 19:53:26.585712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:53:27.673847 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:27.686738 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:53:27.741834 tst ping_idle_ping.py: using LAC 31121 19:53:27.866165 tst ping_idle_ping.py: using RAC 11 19:53:27.989066 tst ping_idle_ping.py: using CellId 31121 19:53:28.106378 tst ping_idle_ping.py: using BVCI 31122 19:53:28.215687 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:28.227308 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:28.238519 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:28.250067 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:28.261298 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:28.272556 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:28.284489 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:53:28.295713 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:53:28.414312 tst ping_idle_ping.py:24: start network... 19:53:28.628738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:29.121251 run create_hlr_db(pid=21127): Launched 19:53:29.243518 bus /gobi_6: Setting Powered False 19:53:30.306311 run create_hlr_db(pid=21127): Terminated: ok {rc=0} 19:53:30.732647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21129): Launched 19:53:31.056533 run osmo-hlr_10.42.42.2(pid=21130): Launched 19:53:31.300516 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:31.982894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21132): Launched 19:53:32.329134 run osmo-stp_10.42.42.5(pid=21133): Launched 19:53:32.441975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:53:32.953361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21135): Launched 19:53:33.066952 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:53:33.318328 run patchelf(pid=21136): Launched 19:53:33.485594 run osmo-stp_10.42.42.5(pid=21133): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21133)] 19:53:33.611229 run osmo-stp_10.42.42.5(pid=21133): stdout: | (launched: 2022-12-12_19:53:32.274733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:33.738717 run osmo-stp_10.42.42.5(pid=21133): stderr: | 20221212195332441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195332441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195332441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195332442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195332442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195332442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195332442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:33.866331 run osmo-stp_10.42.42.5(pid=21133): stdout: | (launched: 2022-12-12_19:53:32.274733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:33.987773 run osmo-stp_10.42.42.5(pid=21133): stderr: | 20221212195332441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195332441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195332441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195332442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195332442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195332442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195332442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:34.131576 run patchelf(pid=21136): Terminating (SIGINT) 19:53:34.297358 run patchelf(pid=21136): Terminated: ok {rc=0} 19:53:34.416403 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21133): Process ended prematurely: osmo-stp_10.42.42.5(pid=21133) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21133)] [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:53:34.425494 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:53:34.452623 run osmo-hlr_10.42.42.2(pid=21130): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21130)] 19:53:34.500909 run osmo-hlr_10.42.42.2(pid=21130): stdout: | (launched: 2022-12-12_19:53:30.998106) 19:53:34.550860 run osmo-hlr_10.42.42.2(pid=21130): stderr: | 20221212195331288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195331288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195331288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195331288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195331288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195331288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195331307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195331319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195331319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195331319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:34.601950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21129): Terminating (SIGTERM) 19:53:34.642253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21132): Terminating (SIGTERM) 19:53:34.683017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21135): Terminating (SIGTERM) 19:53:34.723957 --- ParallelTerminationStrategy: PID 21129 died... 19:53:34.743302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21129): Terminated: ok {rc=0} 19:53:34.788411 --- ParallelTerminationStrategy: PID 21132 died... 19:53:34.807274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21132): Terminated: ok {rc=0} 19:53:34.851986 --- ParallelTerminationStrategy: PID 21135 died... 19:53:34.870975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21135): Terminated: ok {rc=0} 19:53:34.957471 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:53:36.264493 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:53:36.271208 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:53:36.303628 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:53:36.337879 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:53:36.390990 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:53:36.423154 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:53:36.457414 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:53:37.022950 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:53:37.027912 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.039072 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:53:37.107698 tst switch_tch_pdch.py: using LAC 31122 19:53:37.222186 tst switch_tch_pdch.py: using RAC 12 19:53:37.338264 tst switch_tch_pdch.py: using CellId 31122 19:53:37.454293 tst switch_tch_pdch.py: using BVCI 31123 19:53:37.559729 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.570891 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.581931 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.593009 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.603976 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.614916 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.625983 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:53:37.637043 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:53:37.750520 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:53:37.868515 tst switch_tch_pdch.py:51: start network... 19:53:38.081631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:38.572125 run create_hlr_db(pid=21140): Launched 19:53:38.697536 bus /gobi_6: Setting Powered False 19:53:39.756792 run create_hlr_db(pid=21140): Terminated: ok {rc=0} 19:53:40.175104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21142): Launched 19:53:40.470356 run osmo-hlr_10.42.42.2(pid=21143): Launched 19:53:40.582207 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:41.089549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21145): Launched 19:53:41.383128 run osmo-stp_10.42.42.5(pid=21146): Launched 19:53:41.494280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:53:42.001638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21148): Launched 19:53:42.114548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:53:42.362785 run patchelf(pid=21149): Launched 19:53:42.526819 run osmo-stp_10.42.42.5(pid=21146): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21146)] 19:53:42.651914 run osmo-stp_10.42.42.5(pid=21146): stdout: | (launched: 2022-12-12_19:53:41.328899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:42.778773 run osmo-stp_10.42.42.5(pid=21146): stderr: | 20221212195341496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195341497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195341497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195341497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195341498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195341498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195341498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:42.905916 run osmo-stp_10.42.42.5(pid=21146): stdout: | (launched: 2022-12-12_19:53:41.328899) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:43.027094 run osmo-stp_10.42.42.5(pid=21146): stderr: | 20221212195341496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195341497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195341497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195341497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195341498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195341498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195341498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:43.170312 run patchelf(pid=21149): Terminating (SIGINT) 19:53:43.334753 run patchelf(pid=21149): Terminated: ok {rc=0} 19:53:43.453431 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21146): Process ended prematurely: osmo-stp_10.42.42.5(pid=21146) [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21146)] [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:53:43.462366 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 19:53:43.489819 run osmo-hlr_10.42.42.2(pid=21143): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21143)] 19:53:43.537506 run osmo-hlr_10.42.42.2(pid=21143): stdout: | (launched: 2022-12-12_19:53:40.415993) 19:53:43.587102 run osmo-hlr_10.42.42.2(pid=21143): stderr: | 20221212195340587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195340587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195340587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195340587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195340587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195340587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195340599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195340608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195340609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195340609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:43.637079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21142): Terminating (SIGTERM) 19:53:43.676832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21145): Terminating (SIGTERM) 19:53:43.716654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21148): Terminating (SIGTERM) 19:53:43.756463 --- ParallelTerminationStrategy: PID 21142 died... 19:53:43.775556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21142): Terminated: ok {rc=0} 19:53:43.819541 --- ParallelTerminationStrategy: PID 21145 died... 19:53:43.838012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21145): Terminated: ok {rc=0} 19:53:43.881754 --- ParallelTerminationStrategy: PID 21148 died... 19:53:43.900345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21148): Terminated: ok {rc=0} 19:53:43.983610 bus /gobi_0: Setting Powered False 19:53:45.082303 bus /gobi_0: Setting Powered False 19:53:46.202044 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:53:47.546223 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:53:47.554392 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:53:47.604795 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:53:47.654961 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:53:47.717997 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:53:47.764116 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:53:47.814473 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:53:48.374544 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:53:48.381781 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:48.398898 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:53:48.502406 tst switch_tch_pdch.py: using LAC 31123 19:53:48.655184 tst switch_tch_pdch.py: using RAC 13 19:53:48.819655 tst switch_tch_pdch.py: using CellId 31123 19:53:48.950114 tst switch_tch_pdch.py: using BVCI 31124 19:53:49.069830 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:49.082955 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:49.096445 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:49.110488 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:49.122868 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:49.136016 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:49.149589 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:53:49.163893 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:53:49.290795 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:53:49.416810 tst switch_tch_pdch.py:51: start network... 19:53:49.638349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:50.113551 run create_hlr_db(pid=21424): Launched 19:53:50.277251 bus /gobi_6: Setting Powered False 19:53:51.341763 run create_hlr_db(pid=21424): Terminated: ok {rc=0} 19:53:51.766380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21428): Launched 19:53:52.103120 run osmo-hlr_10.42.42.2(pid=21429): Launched 19:53:52.350546 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:52.977222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21431): Launched 19:53:53.309599 run osmo-stp_10.42.42.5(pid=21432): Launched 19:53:53.555893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:53:54.170000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21434): Launched 19:53:54.305653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:53:54.583108 run patchelf(pid=21435): Launched 19:53:54.778718 run osmo-stp_10.42.42.5(pid=21432): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21432)] 19:53:54.917881 run osmo-stp_10.42.42.5(pid=21432): stdout: | (launched: 2022-12-12_19:53:53.251707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:55.060666 run osmo-stp_10.42.42.5(pid=21432): stderr: | 20221212195353547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195353547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195353547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195353548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195353548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195353548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195353549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:55.202429 run osmo-stp_10.42.42.5(pid=21432): stdout: | (launched: 2022-12-12_19:53:53.251707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:55.337495 run osmo-stp_10.42.42.5(pid=21432): stderr: | 20221212195353547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195353547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195353547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195353548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195353548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195353548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195353549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:55.498389 run patchelf(pid=21435): Terminating (SIGINT) 19:53:55.681959 run patchelf(pid=21435): Terminated: ok {rc=0} 19:53:55.814496 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21432): Process ended prematurely: osmo-stp_10.42.42.5(pid=21432) [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21432)] [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:53:55.825261 tst switch_tch_pdch.py:54: Test FAILED (7.4 sec) 19:53:55.857547 run osmo-hlr_10.42.42.2(pid=21429): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21429)] 19:53:55.911463 run osmo-hlr_10.42.42.2(pid=21429): stdout: | (launched: 2022-12-12_19:53:52.044656) 19:53:55.968598 run osmo-hlr_10.42.42.2(pid=21429): stderr: | 20221212195352347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195352347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195352347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195352347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195352347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195352347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195352367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195352379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195352380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195352380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:56.025942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21428): Terminating (SIGTERM) 19:53:56.071408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21431): Terminating (SIGTERM) 19:53:56.118447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21434): Terminating (SIGTERM) 19:53:56.165805 --- ParallelTerminationStrategy: PID 21428 died... 19:53:56.187175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21428): Terminated: ok {rc=0} 19:53:56.240017 --- ParallelTerminationStrategy: PID 21431 died... 19:53:56.261339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21431): Terminated: ok {rc=0} 19:53:56.311405 --- ParallelTerminationStrategy: PID 21434 died... 19:53:56.332436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21434): Terminated: ok {rc=0} 19:53:56.427541 bus /gobi_0: Setting Powered False 19:53:57.534395 bus /gobi_0: Setting Powered False 19:53:58.658072 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_sms:trx-lms --------------------------------------------------------------------- 19:53:59.913551 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:53:59.918258 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 19:53:59.955181 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 19:53:59.962926 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 19:54:00.015902 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 19:54:00.049956 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 19:54:00.057639 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 19:54:00.597584 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 19:54:00.604415 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 19:54:00.616203 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 19:54:00.666960 tst mo_mt_sms.py: using LAC 31124 19:54:00.784009 tst mo_mt_sms.py: using RAC 14 19:54:00.947302 tst mo_mt_sms.py: using CellId 31124 19:54:01.076932 tst mo_mt_sms.py: using BVCI 31125 19:54:01.227524 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 19:54:01.361399 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 19:54:01.498087 tst mo_mt_sms.py:9: start nitb and bts... 19:54:01.743116 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:54:02.400293 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21439): Launched 19:54:02.733789 run osmo-nitb_10.42.42.2(pid=21440): Launched 19:54:02.930893 run osmo-nitb_10.42.42.2(pid=21440): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21440)] 19:54:03.076896 run osmo-nitb_10.42.42.2(pid=21440): stdout: | (launched: 2022-12-12_19:54:02.675521) 19:54:03.225080 run osmo-nitb_10.42.42.2(pid=21440): stderr: | (launched: 2022-12-12_19:54:02.723235) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:54:03.372723 run osmo-nitb_10.42.42.2(pid=21440): stdout: | (launched: 2022-12-12_19:54:02.675521) 19:54:03.515475 run osmo-nitb_10.42.42.2(pid=21440): stderr: | (launched: 2022-12-12_19:54:02.723235) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21440): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21440) [trial-2381↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21440)] 19:54:03.873950 tst osmo-nitb_10.42.42.2(pid=21440): stdout: | (launched: 2022-12-12_19:54:02.675521) 19:54:04.007845 tst osmo-nitb_10.42.42.2(pid=21440): stderr: | (launched: 2022-12-12_19:54:02.723235) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:54:04.164132 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21440): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21440) [trial-2381↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21440)] [trial-2381↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 19:54:04.174460 tst mo_mt_sms.py:11: Test FAILED (3.6 sec) 19:54:04.182949 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21439): Terminating (SIGTERM) 19:54:04.399774 --- ParallelTerminationStrategy: PID 21439 died... 19:54:04.422595 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21439): Terminated: ok {rc=0} 19:54:04.517997 bus /sierra_3: Setting Powered False 19:54:05.618266 bus /sierra_3: Setting Powered False 19:54:06.735060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:trx-lms --------------------------------------------------------------------- 19:54:07.933435 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:54:07.937460 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 19:54:07.973552 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:54:08.002701 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 19:54:08.054739 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 19:54:08.088823 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:54:08.117870 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 19:54:08.662050 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 19:54:08.668919 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:08.680539 tst sms:trx-lms: Using 1 x bts (candidates: 1) 19:54:08.736844 tst mo_mt_sms.py: using LAC 31125 19:54:08.857632 tst mo_mt_sms.py: using RAC 15 19:54:08.987428 tst mo_mt_sms.py: using CellId 31125 19:54:09.117676 tst mo_mt_sms.py: using BVCI 31126 19:54:09.229174 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:09.240631 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:09.252684 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:09.264784 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:09.276415 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:09.288390 tst sms:trx-lms: Using 1 x modem (candidates: 2) 19:54:09.405335 tst sms:trx-lms: Using 1 x modem (candidates: 2) 19:54:09.525890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:54:10.003200 run create_hlr_db(pid=21445): Launched 19:54:10.163641 bus /sierra_2: Setting Powered False 19:54:11.222404 run create_hlr_db(pid=21445): Terminated: ok {rc=0} 19:54:11.636326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21447): Launched 19:54:11.931741 run osmo-hlr_10.42.42.2(pid=21448): Launched 19:54:12.043864 run osmo-stp_10.42.42.5: Starting osmo-stp 19:54:12.550361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21450): Launched 19:54:12.845363 run osmo-stp_10.42.42.5(pid=21451): Launched 19:54:12.957070 run osmo-msc_10.42.42.6: Starting osmo-msc 19:54:13.488768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21453): Launched 19:54:13.783971 run osmo-msc_10.42.42.6(pid=21454): Launched 19:54:13.948149 run osmo-stp_10.42.42.5(pid=21451): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21451)] 19:54:14.072488 run osmo-stp_10.42.42.5(pid=21451): stdout: | (launched: 2022-12-12_19:54:12.790230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:14.198262 run osmo-stp_10.42.42.5(pid=21451): stderr: | 20221212195412961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195412961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195412961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195412962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195412962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195412962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195412962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:14.320925 run osmo-stp_10.42.42.5(pid=21451): stdout: | (launched: 2022-12-12_19:54:12.790230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:14.438385 run osmo-stp_10.42.42.5(pid=21451): stderr: | 20221212195412961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195412961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195412961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195412962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195412962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195412962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195412962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:14.579030 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21451): Process ended prematurely: osmo-stp_10.42.42.5(pid=21451) [trial-2381↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21451)] [trial-2381↪sms:trx-lms↪mo_mt_sms.py:16] 19:54:14.587421 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 19:54:14.613284 run osmo-hlr_10.42.42.2(pid=21448): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21448)] 19:54:14.660836 run osmo-hlr_10.42.42.2(pid=21448): stdout: | (launched: 2022-12-12_19:54:11.876801) 19:54:14.710059 run osmo-hlr_10.42.42.2(pid=21448): stderr: | 20221212195412053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195412053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195412053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195412053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195412053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195412054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195412081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195412091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195412091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195412091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:54:14.778736 run osmo-msc_10.42.42.6(pid=21454): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21454)] 19:54:14.826216 run osmo-msc_10.42.42.6(pid=21454): stdout: | (launched: 2022-12-12_19:54:13.728443) 19:54:14.875429 run osmo-msc_10.42.42.6(pid=21454): stderr: | 20221212195414002 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195414002 DLGLOBAL DEBUG validating counter group 0x7f99bd081c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195414003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195414003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195414003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195414003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195414005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195414005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195414005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195414006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:54:14.925394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21447): Terminating (SIGTERM) 19:54:14.965188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21450): Terminating (SIGTERM) 19:54:15.004860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21453): Terminating (SIGTERM) 19:54:15.044639 --- ParallelTerminationStrategy: PID 21447 died... 19:54:15.063854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21447): Terminated: ok {rc=0} 19:54:15.107656 --- ParallelTerminationStrategy: PID 21450 died... 19:54:15.126161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21450): Terminated: ok {rc=0} 19:54:15.170510 --- ParallelTerminationStrategy: PID 21453 died... 19:54:15.189100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21453): Terminated: ok {rc=0} 19:54:15.272177 bus /sierra_3: Setting Powered False 19:54:16.373409 bus /sierra_3: Setting Powered False 19:54:17.493701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-lms --------------------------------------------------------------------- 19:54:18.786539 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:54:18.790256 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 19:54:18.823304 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 19:54:18.830212 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 19:54:18.865646 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 19:54:18.900031 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 19:54:18.907260 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 19:54:19.431476 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 19:54:19.437937 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 19:54:19.449802 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 19:54:19.499943 tst assert_extension.py: using LAC 31126 19:54:19.623412 tst assert_extension.py: using RAC 16 19:54:19.745769 tst assert_extension.py: using CellId 31126 19:54:19.862631 tst assert_extension.py: using BVCI 31127 19:54:19.968371 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 19:54:20.085448 tst assert_extension.py:10: start nitb and bts... 19:54:20.299640 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:54:20.950491 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21459): Launched 19:54:21.268729 run osmo-nitb_10.42.42.2(pid=21460): Launched 19:54:21.445525 run osmo-nitb_10.42.42.2(pid=21460): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21460)] 19:54:21.588289 run osmo-nitb_10.42.42.2(pid=21460): stdout: | (launched: 2022-12-12_19:54:21.210388) 19:54:21.732302 run osmo-nitb_10.42.42.2(pid=21460): stderr: | (launched: 2022-12-12_19:54:21.257551) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:54:21.876479 run osmo-nitb_10.42.42.2(pid=21460): stdout: | (launched: 2022-12-12_19:54:21.210388) 19:54:22.014980 run osmo-nitb_10.42.42.2(pid=21460): stderr: | (launched: 2022-12-12_19:54:21.257551) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21460): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21460) [trial-2381↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21460)] 19:54:22.389583 tst osmo-nitb_10.42.42.2(pid=21460): stdout: | (launched: 2022-12-12_19:54:21.210388) 19:54:22.518266 tst osmo-nitb_10.42.42.2(pid=21460): stderr: | (launched: 2022-12-12_19:54:21.257551) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:54:22.669498 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21460): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21460) [trial-2381↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21460)] [trial-2381↪nitb_ussd:trx-lms↪assert_extension.py:12] 19:54:22.678718 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:54:22.686001 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21459): Terminating (SIGTERM) 19:54:22.898015 --- ParallelTerminationStrategy: PID 21459 died... 19:54:22.920266 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21459): Terminated: ok {rc=0} 19:54:23.011252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:trx-lms --------------------------------------------------------------------- 19:54:24.191280 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:54:24.195955 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 19:54:24.230103 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:54:24.256844 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 19:54:24.292644 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 19:54:24.325830 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:54:24.352303 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 19:54:24.880890 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:trx-lms assert_extension.py ---------------------------------------------- 19:54:24.886037 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:24.896618 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 19:54:24.944878 tst assert_extension.py: using LAC 31127 19:54:25.070316 tst assert_extension.py: using RAC 17 19:54:25.194610 tst assert_extension.py: using CellId 31127 19:54:25.320580 tst assert_extension.py: using BVCI 31128 19:54:25.435572 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:25.446663 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:25.457626 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:25.468727 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:25.479998 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:54:25.491209 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 19:54:25.608151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:54:26.101799 run create_hlr_db(pid=21464): Launched 19:54:26.222679 bus /sierra_2: Setting Powered False 19:54:27.285958 run create_hlr_db(pid=21464): Terminated: ok {rc=0} 19:54:27.713408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21466): Launched 19:54:28.010884 run osmo-hlr_10.42.42.2(pid=21467): Launched 19:54:28.123928 run osmo-stp_10.42.42.5: Starting osmo-stp 19:54:28.635902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21469): Launched 19:54:28.933678 run osmo-stp_10.42.42.5(pid=21470): Launched 19:54:29.049973 run osmo-msc_10.42.42.6: Starting osmo-msc 19:54:29.583728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21472): Launched 19:54:29.879362 run osmo-msc_10.42.42.6(pid=21473): Launched 19:54:30.044717 run osmo-stp_10.42.42.5(pid=21470): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21470)] 19:54:30.169775 run osmo-stp_10.42.42.5(pid=21470): stdout: | (launched: 2022-12-12_19:54:28.878262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:30.295547 run osmo-stp_10.42.42.5(pid=21470): stderr: | 20221212195429047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195429047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195429047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195429048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195429048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195429048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195429048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:30.419090 run osmo-stp_10.42.42.5(pid=21470): stdout: | (launched: 2022-12-12_19:54:28.878262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:30.537809 run osmo-stp_10.42.42.5(pid=21470): stderr: | 20221212195429047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195429047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195429047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195429048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195429048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195429048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195429048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:30.679066 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21470): Process ended prematurely: osmo-stp_10.42.42.5(pid=21470) [trial-2381↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21470)] [trial-2381↪ussd:trx-lms↪assert_extension.py:17] 19:54:30.687545 tst assert_extension.py:17: Test FAILED (5.8 sec) 19:54:30.713942 run osmo-hlr_10.42.42.2(pid=21467): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21467)] 19:54:30.762190 run osmo-hlr_10.42.42.2(pid=21467): stdout: | (launched: 2022-12-12_19:54:27.955432) 19:54:30.811583 run osmo-hlr_10.42.42.2(pid=21467): stderr: | 20221212195428127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195428127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195428127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195428128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195428128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195428128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195428140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195428149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195428149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195428149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:54:30.901913 run osmo-msc_10.42.42.6(pid=21473): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21473)] 19:54:30.955398 run osmo-msc_10.42.42.6(pid=21473): stdout: | (launched: 2022-12-12_19:54:29.824661) 19:54:31.005681 run osmo-msc_10.42.42.6(pid=21473): stderr: | 20221212195430096 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195430096 DLGLOBAL DEBUG validating counter group 0x7f1279f9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195430096 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195430096 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195430096 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195430096 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195430099 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195430099 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195430100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195430100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:54:31.057134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21466): Terminating (SIGTERM) 19:54:31.098262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21469): Terminating (SIGTERM) 19:54:31.139864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21472): Terminating (SIGTERM) 19:54:31.183150 --- ParallelTerminationStrategy: PID 21466 died... 19:54:31.203004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21466): Terminated: ok {rc=0} 19:54:31.248895 --- ParallelTerminationStrategy: PID 21469 died... 19:54:31.268375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21469): Terminated: ok {rc=0} 19:54:31.313916 --- ParallelTerminationStrategy: PID 21472 died... 19:54:31.333255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21472): Terminated: ok {rc=0} 19:54:31.422207 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:54:32.628545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:54:32.635282 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:54:32.668627 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:54:32.695302 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:54:32.749622 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:54:32.783456 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:54:32.810059 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:54:33.358458 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:54:33.407895 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:33.419327 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:54:33.492742 tst mo_mt_call.py: using LAC 31128 19:54:33.613035 tst mo_mt_call.py: using RAC 18 19:54:33.730851 tst mo_mt_call.py: using CellId 31128 19:54:33.848923 tst mo_mt_call.py: using BVCI 31129 19:54:33.957305 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:33.968270 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:33.979745 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:33.990860 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:34.001982 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:34.012779 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:54:34.132435 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:54:34.251855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:54:34.755516 run create_hlr_db(pid=21481): Launched 19:54:34.879302 bus /sierra_2: Setting Powered False 19:54:35.943143 run create_hlr_db(pid=21481): Terminated: ok {rc=0} 19:54:36.374391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21483): Launched 19:54:36.675544 run osmo-hlr_10.42.42.2(pid=21484): Launched 19:54:36.790153 run osmo-stp_10.42.42.5: Starting osmo-stp 19:54:37.322053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21486): Launched 19:54:37.622808 run osmo-stp_10.42.42.5(pid=21487): Launched 19:54:37.737318 run osmo-msc_10.42.42.6: Starting osmo-msc 19:54:38.279835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21489): Launched 19:54:38.581493 run osmo-msc_10.42.42.6(pid=21490): Launched 19:54:38.749564 run osmo-stp_10.42.42.5(pid=21487): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21487)] 19:54:38.875606 run osmo-stp_10.42.42.5(pid=21487): stdout: | (launched: 2022-12-12_19:54:37.567129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:39.001785 run osmo-stp_10.42.42.5(pid=21487): stderr: | 20221212195437736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195437736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195437736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195437737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195437737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195437737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195437738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:39.126806 run osmo-stp_10.42.42.5(pid=21487): stdout: | (launched: 2022-12-12_19:54:37.567129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:39.245788 run osmo-stp_10.42.42.5(pid=21487): stderr: | 20221212195437736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195437736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195437736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195437737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195437737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195437737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195437738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:39.387913 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21487): Process ended prematurely: osmo-stp_10.42.42.5(pid=21487) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21487)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:54:39.397181 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:54:39.423511 run osmo-hlr_10.42.42.2(pid=21484): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21484)] 19:54:39.471814 run osmo-hlr_10.42.42.2(pid=21484): stdout: | (launched: 2022-12-12_19:54:36.619574) 19:54:39.521293 run osmo-hlr_10.42.42.2(pid=21484): stderr: | 20221212195436794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195436794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195436794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195436794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195436794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195436794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195436807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195436817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195436817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195436817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:54:39.590217 run osmo-msc_10.42.42.6(pid=21490): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21490)] 19:54:39.637784 run osmo-msc_10.42.42.6(pid=21490): stdout: | (launched: 2022-12-12_19:54:38.525183) 19:54:39.687045 run osmo-msc_10.42.42.6(pid=21490): stderr: | 20221212195438796 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195438796 DLGLOBAL DEBUG validating counter group 0x7f9a4879cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195438796 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195438796 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195438797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195438797 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195438799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195438799 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195438799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195438799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:54:39.736512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21483): Terminating (SIGTERM) 19:54:39.775847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21486): Terminating (SIGTERM) 19:54:39.816582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21489): Terminating (SIGTERM) 19:54:39.856192 --- ParallelTerminationStrategy: PID 21483 died... 19:54:39.875175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21483): Terminated: ok {rc=0} 19:54:39.918676 --- ParallelTerminationStrategy: PID 21486 died... 19:54:39.937164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21486): Terminated: ok {rc=0} 19:54:39.980723 --- ParallelTerminationStrategy: PID 21489 died... 19:54:39.999559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21489): Terminated: ok {rc=0} 19:54:40.083831 bus /sierra_3: Setting Powered False 19:54:41.180154 bus /sierra_3: Setting Powered False 19:54:42.296748 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:54:43.444795 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:43.456780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:54:43.526535 tst mo_mt_call_osmux.py: using LAC 31129 19:54:43.653511 tst mo_mt_call_osmux.py: using RAC 19 19:54:43.779966 tst mo_mt_call_osmux.py: using CellId 31129 19:54:43.911495 tst mo_mt_call_osmux.py: using BVCI 31130 19:54:44.029417 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:44.041117 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:44.052459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:44.064272 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:44.076011 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:54:44.087735 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:54:44.206952 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:54:44.331931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:54:44.832396 run create_hlr_db(pid=21492): Launched 19:54:44.957422 bus /sierra_2: Setting Powered False 19:54:46.023846 run create_hlr_db(pid=21492): Terminated: ok {rc=0} 19:54:46.457735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Launched 19:54:46.792306 run osmo-hlr_10.42.42.2(pid=21495): Launched 19:54:47.059029 run osmo-stp_10.42.42.5: Starting osmo-stp 19:54:47.679621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Launched 19:54:47.984689 run osmo-stp_10.42.42.5(pid=21498): Launched 19:54:48.100260 run osmo-msc_10.42.42.6: Starting osmo-msc 19:54:48.646976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21500): Launched 19:54:48.949047 run osmo-msc_10.42.42.6(pid=21501): Launched 19:54:49.116565 run osmo-stp_10.42.42.5(pid=21498): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)] 19:54:49.244574 run osmo-stp_10.42.42.5(pid=21498): stdout: | (launched: 2022-12-12_19:54:47.927063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:49.372143 run osmo-stp_10.42.42.5(pid=21498): stderr: | 20221212195448098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195448098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195448098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195448098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195448099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195448099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195448099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:49.498056 run osmo-stp_10.42.42.5(pid=21498): stdout: | (launched: 2022-12-12_19:54:47.927063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:54:49.618534 run osmo-stp_10.42.42.5(pid=21498): stderr: | 20221212195448098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195448098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195448098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195448098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195448099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195448099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195448099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:54:49.762193 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21498): Process ended prematurely: osmo-stp_10.42.42.5(pid=21498) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:54:49.771073 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:54:49.797779 run osmo-hlr_10.42.42.2(pid=21495): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21495)] 19:54:49.846126 run osmo-hlr_10.42.42.2(pid=21495): stdout: | (launched: 2022-12-12_19:54:46.732525) 19:54:49.895902 run osmo-hlr_10.42.42.2(pid=21495): stderr: | 20221212195446968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195446968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195446968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195446968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195446968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195446968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195446998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195447007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195447007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195447007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:54:49.965555 run osmo-msc_10.42.42.6(pid=21501): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21501)] 19:54:50.013691 run osmo-msc_10.42.42.6(pid=21501): stdout: | (launched: 2022-12-12_19:54:48.893149) 19:54:50.063852 run osmo-msc_10.42.42.6(pid=21501): stderr: | 20221212195449166 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195449166 DLGLOBAL DEBUG validating counter group 0x7fc1c80f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195449166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195449167 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195449167 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195449168 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195449169 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195449170 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195449170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195449170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:54:50.114147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Terminating (SIGTERM) 19:54:50.154124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Terminating (SIGTERM) 19:54:50.194372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21500): Terminating (SIGTERM) 19:54:50.234764 --- ParallelTerminationStrategy: PID 21494 died... 19:54:50.253883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Terminated: ok {rc=0} 19:54:50.297624 --- ParallelTerminationStrategy: PID 21497 died... 19:54:50.316234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Terminated: ok {rc=0} 19:54:50.359824 --- ParallelTerminationStrategy: PID 21500 died... 19:54:50.378364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21500): Terminated: ok {rc=0} 19:54:50.464054 bus /sierra_3: Setting Powered False 19:54:51.563169 bus /sierra_3: Setting Powered False 19:54:52.678361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:54:53.926616 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:54:53.933334 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:54:53.966831 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:54:53.993399 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:54:54.046410 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:54:54.079637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:54:54.106056 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:54:54.655215 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:54:54.709032 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:54:54.720661 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:54:54.792425 tst mo_mt_call.py: using LAC 31130 19:54:54.913336 tst mo_mt_call.py: using RAC 20 19:54:55.033250 tst mo_mt_call.py: using CellId 31130 19:54:55.151128 tst mo_mt_call.py: using BVCI 31131 19:54:55.262298 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:54:55.273417 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:54:55.284332 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:54:55.295206 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:54:55.306160 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:54:55.317043 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:54:55.435089 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:54:55.552529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:54:56.019779 run create_hlr_db(pid=21506): Launched 19:54:56.142888 bus /sierra_2: Setting Powered False 19:54:57.203406 run create_hlr_db(pid=21506): Terminated: ok {rc=0} 19:54:57.625716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21508): Launched 19:54:57.927541 run osmo-hlr_10.42.42.2(pid=21509): Launched 19:54:58.042523 run osmo-stp_10.42.42.5: Starting osmo-stp 19:54:58.559224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21511): Launched 19:54:58.861539 run osmo-stp_10.42.42.5(pid=21512): Launched 19:54:58.976228 run osmo-msc_10.42.42.6: Starting osmo-msc 19:54:59.521289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21514): Launched 19:54:59.822022 run osmo-msc_10.42.42.6(pid=21515): Launched 19:54:59.990207 run osmo-stp_10.42.42.5(pid=21512): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21512)] 19:55:00.117853 run osmo-stp_10.42.42.5(pid=21512): stdout: | (launched: 2022-12-12_19:54:58.805642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:00.244738 run osmo-stp_10.42.42.5(pid=21512): stderr: | 20221212195458973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195458973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195458973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195458974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195458974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195458974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195458975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:00.369942 run osmo-stp_10.42.42.5(pid=21512): stdout: | (launched: 2022-12-12_19:54:58.805642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:00.489235 run osmo-stp_10.42.42.5(pid=21512): stderr: | 20221212195458973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195458973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195458973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195458974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195458974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195458974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195458975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:00.631856 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21512): Process ended prematurely: osmo-stp_10.42.42.5(pid=21512) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21512)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:55:00.640763 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:55:00.667179 run osmo-hlr_10.42.42.2(pid=21509): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21509)] 19:55:00.714782 run osmo-hlr_10.42.42.2(pid=21509): stdout: | (launched: 2022-12-12_19:54:57.872020) 19:55:00.764057 run osmo-hlr_10.42.42.2(pid=21509): stderr: | 20221212195458049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195458049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195458049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195458049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195458049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195458049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195458061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195458070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195458070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195458070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:00.833043 run osmo-msc_10.42.42.6(pid=21515): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21515)] 19:55:00.902625 run osmo-msc_10.42.42.6(pid=21515): stdout: | (launched: 2022-12-12_19:54:59.766042) 19:55:00.961190 run osmo-msc_10.42.42.6(pid=21515): stderr: | 20221212195500037 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195500037 DLGLOBAL DEBUG validating counter group 0x7f1d49794c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195500037 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195500037 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195500037 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195500037 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195500040 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195500041 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195500041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195500041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:01.018744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21508): Terminating (SIGTERM) 19:55:01.063922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21511): Terminating (SIGTERM) 19:55:01.111219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21514): Terminating (SIGTERM) 19:55:01.158394 --- ParallelTerminationStrategy: PID 21508 died... 19:55:01.179353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21508): Terminated: ok {rc=0} 19:55:01.232235 --- ParallelTerminationStrategy: PID 21511 died... 19:55:01.253292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21511): Terminated: ok {rc=0} 19:55:01.304208 --- ParallelTerminationStrategy: PID 21514 died... 19:55:01.325215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21514): Terminated: ok {rc=0} 19:55:01.430611 bus /sierra_3: Setting Powered False 19:55:02.530251 bus /sierra_3: Setting Powered False 19:55:03.648028 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:55:04.796010 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:55:04.807829 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:55:04.879039 tst mo_mt_call_osmux.py: using LAC 31131 19:55:04.998477 tst mo_mt_call_osmux.py: using RAC 21 19:55:05.126539 tst mo_mt_call_osmux.py: using CellId 31131 19:55:05.253452 tst mo_mt_call_osmux.py: using BVCI 31132 19:55:05.363452 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:55:05.374694 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:55:05.385679 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:55:05.397444 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:55:05.408308 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:55:05.419454 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:55:05.532130 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:55:05.652460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:06.119686 run create_hlr_db(pid=21520): Launched 19:55:06.243984 bus /sierra_2: Setting Powered False 19:55:07.305161 run create_hlr_db(pid=21520): Terminated: ok {rc=0} 19:55:07.748293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21522): Launched 19:55:08.072103 run osmo-hlr_10.42.42.2(pid=21523): Launched 19:55:08.195465 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:08.749943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21525): Launched 19:55:09.074355 run osmo-stp_10.42.42.5(pid=21526): Launched 19:55:09.198822 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:09.783983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21528): Launched 19:55:10.109167 run osmo-msc_10.42.42.6(pid=21529): Launched 19:55:10.291143 run osmo-stp_10.42.42.5(pid=21526): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21526)] 19:55:10.427865 run osmo-stp_10.42.42.5(pid=21526): stdout: | (launched: 2022-12-12_19:55:09.014999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:10.566997 run osmo-stp_10.42.42.5(pid=21526): stderr: | 20221212195509205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195509205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195509205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195509206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195509206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195509206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195509206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:10.701972 run osmo-stp_10.42.42.5(pid=21526): stdout: | (launched: 2022-12-12_19:55:09.014999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:10.830517 run osmo-stp_10.42.42.5(pid=21526): stderr: | 20221212195509205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195509205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195509205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195509206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195509206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195509206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195509206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:10.984228 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21526): Process ended prematurely: osmo-stp_10.42.42.5(pid=21526) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21526)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:55:10.993925 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:55:11.022329 run osmo-hlr_10.42.42.2(pid=21523): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21523)] 19:55:11.074282 run osmo-hlr_10.42.42.2(pid=21523): stdout: | (launched: 2022-12-12_19:55:08.012724) 19:55:11.127361 run osmo-hlr_10.42.42.2(pid=21523): stderr: | 20221212195508210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195508210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195508210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195508210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195508210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195508211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195508223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195508232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195508232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195508232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:11.201239 run osmo-msc_10.42.42.6(pid=21529): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21529)] 19:55:11.252197 run osmo-msc_10.42.42.6(pid=21529): stdout: | (launched: 2022-12-12_19:55:10.049724) 19:55:11.305170 run osmo-msc_10.42.42.6(pid=21529): stderr: | 20221212195510369 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195510369 DLGLOBAL DEBUG validating counter group 0x7f9e2c949c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195510369 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195510369 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195510370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195510370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195510371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195510372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195510372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195510372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:11.358604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21522): Terminating (SIGTERM) 19:55:11.401063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21525): Terminating (SIGTERM) 19:55:11.443516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21528): Terminating (SIGTERM) 19:55:11.486641 --- ParallelTerminationStrategy: PID 21522 died... 19:55:11.506982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21522): Terminated: ok {rc=0} 19:55:11.554875 --- ParallelTerminationStrategy: PID 21525 died... 19:55:11.574865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21525): Terminated: ok {rc=0} 19:55:11.622432 --- ParallelTerminationStrategy: PID 21528 died... 19:55:11.642404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21528): Terminated: ok {rc=0} 19:55:11.731976 bus /sierra_3: Setting Powered False 19:55:12.833083 bus /sierra_3: Setting Powered False 19:55:13.952939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:55:15.202624 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:15.209516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:55:15.242374 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:55:15.269149 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:55:15.323565 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:55:15.356413 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:55:15.383139 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:55:15.957346 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:55:16.014671 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:16.027358 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:55:16.102227 tst mo_mt_call.py: using LAC 31132 19:55:16.258336 tst mo_mt_call.py: using RAC 22 19:55:16.388123 tst mo_mt_call.py: using CellId 31132 19:55:16.559146 tst mo_mt_call.py: using BVCI 31133 19:55:16.680071 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:16.692814 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:16.706474 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:16.720233 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:16.733206 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:16.746659 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:55:16.882838 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:55:17.007179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:17.521247 run create_hlr_db(pid=21535): Launched 19:55:17.646577 bus /sierra_2: Setting Powered False 19:55:18.712248 run create_hlr_db(pid=21535): Terminated: ok {rc=0} 19:55:19.145616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Launched 19:55:19.450005 run osmo-hlr_10.42.42.2(pid=21538): Launched 19:55:19.566476 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:20.086487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Launched 19:55:20.390469 run osmo-stp_10.42.42.5(pid=21541): Launched 19:55:20.506901 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:21.052061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Launched 19:55:21.354435 run osmo-msc_10.42.42.6(pid=21544): Launched 19:55:21.525279 run osmo-stp_10.42.42.5(pid=21541): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] 19:55:21.652846 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-12_19:55:20.334414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:21.779863 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221212195520506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195520506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195520506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195520507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195520507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195520507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195520507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:21.905145 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-12_19:55:20.334414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:22.024382 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221212195520506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195520506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195520506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195520507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195520507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195520507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195520507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:22.167688 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:55:22.176478 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:55:22.202885 run osmo-hlr_10.42.42.2(pid=21538): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21538)] 19:55:22.250860 run osmo-hlr_10.42.42.2(pid=21538): stdout: | (launched: 2022-12-12_19:55:19.393327) 19:55:22.300479 run osmo-hlr_10.42.42.2(pid=21538): stderr: | 20221212195519569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195519569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195519569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195519569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195519569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195519569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195519581 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195519590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195519591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195519591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:22.369765 run osmo-msc_10.42.42.6(pid=21544): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21544)] 19:55:22.417608 run osmo-msc_10.42.42.6(pid=21544): stdout: | (launched: 2022-12-12_19:55:21.298782) 19:55:22.467097 run osmo-msc_10.42.42.6(pid=21544): stderr: | 20221212195521569 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195521569 DLGLOBAL DEBUG validating counter group 0x7f2d63c9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195521569 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195521570 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195521570 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195521570 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195521572 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195521572 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195521572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195521572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:22.516923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminating (SIGTERM) 19:55:22.556729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminating (SIGTERM) 19:55:22.596477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Terminating (SIGTERM) 19:55:22.636375 --- ParallelTerminationStrategy: PID 21537 died... 19:55:22.655480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminated: ok {rc=0} 19:55:22.699902 --- ParallelTerminationStrategy: PID 21540 died... 19:55:22.718416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminated: ok {rc=0} 19:55:22.762891 --- ParallelTerminationStrategy: PID 21543 died... 19:55:22.781608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Terminated: ok {rc=0} 19:55:22.868314 bus /sierra_3: Setting Powered False 19:55:23.969895 bus /sierra_3: Setting Powered False 19:55:25.087563 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:55:26.241399 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:26.253777 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:55:26.326171 tst mo_mt_call_osmux.py: using LAC 31133 19:55:26.453978 tst mo_mt_call_osmux.py: using RAC 23 19:55:26.584489 tst mo_mt_call_osmux.py: using CellId 31133 19:55:26.704758 tst mo_mt_call_osmux.py: using BVCI 31134 19:55:26.814016 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:26.825373 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:26.836337 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:26.848055 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:26.859654 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:55:26.871525 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:55:26.990298 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:55:27.107835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:27.577828 run create_hlr_db(pid=21546): Launched 19:55:27.701139 bus /sierra_2: Setting Powered False 19:55:28.761806 run create_hlr_db(pid=21546): Terminated: ok {rc=0} 19:55:29.184157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21548): Launched 19:55:29.486943 run osmo-hlr_10.42.42.2(pid=21549): Launched 19:55:29.603790 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:30.121540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21551): Launched 19:55:30.422952 run osmo-stp_10.42.42.5(pid=21552): Launched 19:55:30.539974 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:31.097877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21554): Launched 19:55:31.416768 run osmo-msc_10.42.42.6(pid=21555): Launched 19:55:31.692813 run osmo-stp_10.42.42.5(pid=21552): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21552)] 19:55:32.009690 run osmo-stp_10.42.42.5(pid=21552): stdout: | (launched: 2022-12-12_19:55:30.367244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:32.147842 run osmo-stp_10.42.42.5(pid=21552): stderr: | 20221212195530536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195530536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195530537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195530537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195530538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195530538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195530538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:32.287681 run osmo-stp_10.42.42.5(pid=21552): stdout: | (launched: 2022-12-12_19:55:30.367244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:32.418066 run osmo-stp_10.42.42.5(pid=21552): stderr: | 20221212195530536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195530536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195530537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195530537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195530538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195530538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195530538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:32.573205 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21552): Process ended prematurely: osmo-stp_10.42.42.5(pid=21552) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21552)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:55:32.582961 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:55:32.612051 run osmo-hlr_10.42.42.2(pid=21549): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21549)] 19:55:32.663261 run osmo-hlr_10.42.42.2(pid=21549): stdout: | (launched: 2022-12-12_19:55:29.431030) 19:55:32.716337 run osmo-hlr_10.42.42.2(pid=21549): stderr: | 20221212195529608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195529608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195529608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195529608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195529608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195529608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195529637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195529646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195529646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195529646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:32.790544 run osmo-msc_10.42.42.6(pid=21555): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21555)] 19:55:32.841732 run osmo-msc_10.42.42.6(pid=21555): stdout: | (launched: 2022-12-12_19:55:31.360291) 19:55:32.894666 run osmo-msc_10.42.42.6(pid=21555): stderr: | 20221212195531853 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195531853 DLGLOBAL DEBUG validating counter group 0x7f8444a9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195531853 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195531853 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195531854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195531854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195531855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195531856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195531856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195531856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:32.948200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21548): Terminating (SIGTERM) 19:55:32.991073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21551): Terminating (SIGTERM) 19:55:33.033824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21554): Terminating (SIGTERM) 19:55:33.076683 --- ParallelTerminationStrategy: PID 21548 died... 19:55:33.097275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21548): Terminated: ok {rc=0} 19:55:33.145373 --- ParallelTerminationStrategy: PID 21551 died... 19:55:33.165310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21551): Terminated: ok {rc=0} 19:55:33.212721 --- ParallelTerminationStrategy: PID 21554 died... 19:55:33.232898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21554): Terminated: ok {rc=0} 19:55:33.322959 bus /sierra_3: Setting Powered False 19:55:34.423080 bus /sierra_3: Setting Powered False 19:55:35.541224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:55:36.794305 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:36.801994 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:55:36.837406 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:55:36.865534 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:55:36.919658 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:55:36.954338 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:55:36.981845 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:55:37.532696 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:55:37.585737 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:37.597830 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:55:37.669133 tst mo_mt_call.py: using LAC 31134 19:55:37.796241 tst mo_mt_call.py: using RAC 24 19:55:37.922484 tst mo_mt_call.py: using CellId 31134 19:55:38.049582 tst mo_mt_call.py: using BVCI 31135 19:55:38.159657 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:38.171015 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:38.182131 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:38.193858 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:38.205580 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:38.217332 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:55:38.335653 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:55:38.450838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:38.919271 run create_hlr_db(pid=21560): Launched 19:55:39.043628 bus /sierra_2: Setting Powered False 19:55:40.104447 run create_hlr_db(pid=21560): Terminated: ok {rc=0} 19:55:40.524920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21562): Launched 19:55:40.826000 run osmo-hlr_10.42.42.2(pid=21563): Launched 19:55:40.939919 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:41.456515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21565): Launched 19:55:41.758163 run osmo-stp_10.42.42.5(pid=21566): Launched 19:55:41.872047 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:42.445466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21568): Launched 19:55:42.746153 run osmo-msc_10.42.42.6(pid=21569): Launched 19:55:42.914048 run osmo-stp_10.42.42.5(pid=21566): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21566)] 19:55:43.040911 run osmo-stp_10.42.42.5(pid=21566): stdout: | (launched: 2022-12-12_19:55:41.702350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:43.167753 run osmo-stp_10.42.42.5(pid=21566): stderr: | 20221212195541873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195541873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195541873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195541874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195541874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195541874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195541874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:43.293428 run osmo-stp_10.42.42.5(pid=21566): stdout: | (launched: 2022-12-12_19:55:41.702350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:43.412197 run osmo-stp_10.42.42.5(pid=21566): stderr: | 20221212195541873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195541873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195541873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195541874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195541874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195541874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195541874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:43.555119 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21566): Process ended prematurely: osmo-stp_10.42.42.5(pid=21566) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21566)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:55:43.563963 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:55:43.590374 run osmo-hlr_10.42.42.2(pid=21563): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21563)] 19:55:43.638975 run osmo-hlr_10.42.42.2(pid=21563): stdout: | (launched: 2022-12-12_19:55:40.770354) 19:55:43.688678 run osmo-hlr_10.42.42.2(pid=21563): stderr: | 20221212195540945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195540945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195540945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195540945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195540945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195540945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195540961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195540972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195540972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195540972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:43.758477 run osmo-msc_10.42.42.6(pid=21569): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21569)] 19:55:43.806581 run osmo-msc_10.42.42.6(pid=21569): stdout: | (launched: 2022-12-12_19:55:42.690021) 19:55:43.856293 run osmo-msc_10.42.42.6(pid=21569): stderr: | 20221212195542959 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195542959 DLGLOBAL DEBUG validating counter group 0x7f5039955c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195542959 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195542959 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195542959 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195542960 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195542961 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195542962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195542962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195542962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:43.906357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21562): Terminating (SIGTERM) 19:55:43.945856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21565): Terminating (SIGTERM) 19:55:43.985785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21568): Terminating (SIGTERM) 19:55:44.025697 --- ParallelTerminationStrategy: PID 21562 died... 19:55:44.044864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21562): Terminated: ok {rc=0} 19:55:44.088924 --- ParallelTerminationStrategy: PID 21565 died... 19:55:44.107674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21565): Terminated: ok {rc=0} 19:55:44.151608 --- ParallelTerminationStrategy: PID 21568 died... 19:55:44.170322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21568): Terminated: ok {rc=0} 19:55:44.256730 bus /sierra_3: Setting Powered False 19:55:45.356462 bus /sierra_3: Setting Powered False 19:55:46.470476 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:55:47.616037 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:47.628487 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:55:47.700578 tst mo_mt_call_osmux.py: using LAC 31135 19:55:47.818675 tst mo_mt_call_osmux.py: using RAC 25 19:55:47.938353 tst mo_mt_call_osmux.py: using CellId 31135 19:55:48.056329 tst mo_mt_call_osmux.py: using BVCI 31136 19:55:48.176102 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:48.187885 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:48.199507 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:48.211458 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:48.223445 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:55:48.235207 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:55:48.351266 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:55:48.470709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:55:48.972593 run create_hlr_db(pid=21571): Launched 19:55:49.095965 bus /sierra_2: Setting Powered False 19:55:50.160566 run create_hlr_db(pid=21571): Terminated: ok {rc=0} 19:55:50.593201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21573): Launched 19:55:50.895192 run osmo-hlr_10.42.42.2(pid=21574): Launched 19:55:51.010117 run osmo-stp_10.42.42.5: Starting osmo-stp 19:55:51.529197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21576): Launched 19:55:51.831169 run osmo-stp_10.42.42.5(pid=21577): Launched 19:55:51.946380 run osmo-msc_10.42.42.6: Starting osmo-msc 19:55:52.491068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21579): Launched 19:55:52.793812 run osmo-msc_10.42.42.6(pid=21580): Launched 19:55:52.978194 run osmo-stp_10.42.42.5(pid=21577): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21577)] 19:55:53.117564 run osmo-stp_10.42.42.5(pid=21577): stdout: | (launched: 2022-12-12_19:55:51.775236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:53.256637 run osmo-stp_10.42.42.5(pid=21577): stderr: | 20221212195551942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195551942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195551943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195551943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195551943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195551943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195551944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:53.392898 run osmo-stp_10.42.42.5(pid=21577): stdout: | (launched: 2022-12-12_19:55:51.775236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:55:53.523019 run osmo-stp_10.42.42.5(pid=21577): stderr: | 20221212195551942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195551942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195551943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195551943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195551943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195551943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195551944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:55:53.678603 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21577): Process ended prematurely: osmo-stp_10.42.42.5(pid=21577) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21577)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:55:53.688709 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:55:53.718203 run osmo-hlr_10.42.42.2(pid=21574): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21574)] 19:55:53.769805 run osmo-hlr_10.42.42.2(pid=21574): stdout: | (launched: 2022-12-12_19:55:50.839422) 19:55:53.823248 run osmo-hlr_10.42.42.2(pid=21574): stderr: | 20221212195551014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195551014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195551014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195551014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195551014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195551014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195551030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195551040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195551040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195551040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:55:53.897557 run osmo-msc_10.42.42.6(pid=21580): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21580)] 19:55:53.949304 run osmo-msc_10.42.42.6(pid=21580): stdout: | (launched: 2022-12-12_19:55:52.737413) 19:55:54.002583 run osmo-msc_10.42.42.6(pid=21580): stderr: | 20221212195553053 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195553054 DLGLOBAL DEBUG validating counter group 0x7fce0f65ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195553054 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195553054 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195553054 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195553054 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195553056 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195553056 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195553056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195553056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:55:54.056888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21573): Terminating (SIGTERM) 19:55:54.100352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21576): Terminating (SIGTERM) 19:55:54.143828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21579): Terminating (SIGTERM) 19:55:54.188024 --- ParallelTerminationStrategy: PID 21573 died... 19:55:54.208484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21573): Terminated: ok {rc=0} 19:55:54.256539 --- ParallelTerminationStrategy: PID 21576 died... 19:55:54.276864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21576): Terminated: ok {rc=0} 19:55:54.324879 --- ParallelTerminationStrategy: PID 21579 died... 19:55:54.345222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21579): Terminated: ok {rc=0} 19:55:54.436770 bus /sierra_3: Setting Powered False 19:55:55.538227 bus /sierra_3: Setting Powered False 19:55:56.657572 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:55:57.915372 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:55:57.921798 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:55:57.954637 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:55:57.981149 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:55:58.033861 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:55:58.068072 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:55:58.095305 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:55:58.642986 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:55:58.692469 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:55:58.703616 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:55:58.773409 tst mo_mt_call.py: using LAC 31136 19:55:58.894204 tst mo_mt_call.py: using RAC 26 19:55:59.014064 tst mo_mt_call.py: using CellId 31136 19:55:59.132435 tst mo_mt_call.py: using BVCI 31137 19:55:59.243298 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:55:59.254389 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:55:59.265268 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:55:59.276121 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:55:59.287111 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:55:59.298045 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:55:59.416009 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:55:59.536359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:00.036490 run create_hlr_db(pid=21585): Launched 19:56:00.161365 bus /sierra_2: Setting Powered False 19:56:01.222664 run create_hlr_db(pid=21585): Terminated: ok {rc=0} 19:56:01.660682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21587): Launched 19:56:01.984748 run osmo-hlr_10.42.42.2(pid=21588): Launched 19:56:02.195806 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:02.728893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21590): Launched 19:56:03.030093 run osmo-stp_10.42.42.5(pid=21591): Launched 19:56:03.144179 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:03.686707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21593): Launched 19:56:03.990197 run osmo-msc_10.42.42.6(pid=21594): Launched 19:56:04.160567 run osmo-stp_10.42.42.5(pid=21591): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21591)] 19:56:04.287771 run osmo-stp_10.42.42.5(pid=21591): stdout: | (launched: 2022-12-12_19:56:02.973977) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:04.414688 run osmo-stp_10.42.42.5(pid=21591): stderr: | 20221212195603141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195603142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195603142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195603142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195603143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195603143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195603143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:04.539590 run osmo-stp_10.42.42.5(pid=21591): stdout: | (launched: 2022-12-12_19:56:02.973977) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:04.658922 run osmo-stp_10.42.42.5(pid=21591): stderr: | 20221212195603141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195603142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195603142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195603142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195603143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195603143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195603143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:04.801415 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21591): Process ended prematurely: osmo-stp_10.42.42.5(pid=21591) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21591)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:56:04.810218 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:56:04.836391 run osmo-hlr_10.42.42.2(pid=21588): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21588)] 19:56:04.883893 run osmo-hlr_10.42.42.2(pid=21588): stdout: | (launched: 2022-12-12_19:56:01.928030) 19:56:04.933337 run osmo-hlr_10.42.42.2(pid=21588): stderr: | 20221212195602207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195602208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195602208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195602208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195602208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195602208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195602221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195602230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195602231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195602231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:05.001954 run osmo-msc_10.42.42.6(pid=21594): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21594)] 19:56:05.049595 run osmo-msc_10.42.42.6(pid=21594): stdout: | (launched: 2022-12-12_19:56:03.934223) 19:56:05.099127 run osmo-msc_10.42.42.6(pid=21594): stderr: | 20221212195604206 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195604207 DLGLOBAL DEBUG validating counter group 0x7f8a33408c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195604207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195604207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195604207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195604207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195604209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195604209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195604209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195604210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:05.148787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21587): Terminating (SIGTERM) 19:56:05.188259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21590): Terminating (SIGTERM) 19:56:05.227742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21593): Terminating (SIGTERM) 19:56:05.267509 --- ParallelTerminationStrategy: PID 21587 died... 19:56:05.286631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21587): Terminated: ok {rc=0} 19:56:05.330506 --- ParallelTerminationStrategy: PID 21590 died... 19:56:05.349193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21590): Terminated: ok {rc=0} 19:56:05.392793 --- ParallelTerminationStrategy: PID 21593 died... 19:56:05.411731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21593): Terminated: ok {rc=0} 19:56:05.495749 bus /sierra_3: Setting Powered False 19:56:06.594531 bus /sierra_3: Setting Powered False 19:56:07.712572 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:56:08.856705 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:56:08.868532 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:56:08.938602 tst mo_mt_call_osmux.py: using LAC 31137 19:56:09.057192 tst mo_mt_call_osmux.py: using RAC 27 19:56:09.174625 tst mo_mt_call_osmux.py: using CellId 31137 19:56:09.293373 tst mo_mt_call_osmux.py: using BVCI 31138 19:56:09.402160 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:56:09.413361 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:56:09.424326 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:56:09.435267 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:56:09.446341 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:56:09.457388 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:56:09.579146 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:56:09.696067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:10.163866 run create_hlr_db(pid=21596): Launched 19:56:10.288315 bus /sierra_2: Setting Powered False 19:56:11.348877 run create_hlr_db(pid=21596): Terminated: ok {rc=0} 19:56:11.769565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21598): Launched 19:56:12.071861 run osmo-hlr_10.42.42.2(pid=21599): Launched 19:56:12.185789 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:12.706828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21601): Launched 19:56:13.010112 run osmo-stp_10.42.42.5(pid=21602): Launched 19:56:13.127232 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:13.672146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21604): Launched 19:56:13.973973 run osmo-msc_10.42.42.6(pid=21605): Launched 19:56:14.142463 run osmo-stp_10.42.42.5(pid=21602): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21602)] 19:56:14.269251 run osmo-stp_10.42.42.5(pid=21602): stdout: | (launched: 2022-12-12_19:56:12.954296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:14.395829 run osmo-stp_10.42.42.5(pid=21602): stderr: | 20221212195613123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195613124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195613124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195613124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195613125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195613125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195613125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:14.520791 run osmo-stp_10.42.42.5(pid=21602): stdout: | (launched: 2022-12-12_19:56:12.954296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:14.640058 run osmo-stp_10.42.42.5(pid=21602): stderr: | 20221212195613123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195613124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195613124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195613124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195613125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195613125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195613125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:14.782968 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21602): Process ended prematurely: osmo-stp_10.42.42.5(pid=21602) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21602)] [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:56:14.791827 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:56:14.818544 run osmo-hlr_10.42.42.2(pid=21599): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21599)] 19:56:14.866849 run osmo-hlr_10.42.42.2(pid=21599): stdout: | (launched: 2022-12-12_19:56:12.016293) 19:56:14.917112 run osmo-hlr_10.42.42.2(pid=21599): stderr: | 20221212195612190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195612190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195612190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195612190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195612191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195612191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195612203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195612213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195612213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195612213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:14.986947 run osmo-msc_10.42.42.6(pid=21605): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21605)] 19:56:15.035157 run osmo-msc_10.42.42.6(pid=21605): stdout: | (launched: 2022-12-12_19:56:13.918133) 19:56:15.085457 run osmo-msc_10.42.42.6(pid=21605): stderr: | 20221212195614190 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195614190 DLGLOBAL DEBUG validating counter group 0x7f6a63e5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195614190 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195614190 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195614190 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195614191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195614192 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195614194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195614194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195614194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:15.135589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21598): Terminating (SIGTERM) 19:56:15.175178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21601): Terminating (SIGTERM) 19:56:15.214779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21604): Terminating (SIGTERM) 19:56:15.254683 --- ParallelTerminationStrategy: PID 21598 died... 19:56:15.273929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21598): Terminated: ok {rc=0} 19:56:15.317932 --- ParallelTerminationStrategy: PID 21601 died... 19:56:15.336592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21601): Terminated: ok {rc=0} 19:56:15.380580 --- ParallelTerminationStrategy: PID 21604 died... 19:56:15.399344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21604): Terminated: ok {rc=0} 19:56:15.483493 bus /sierra_3: Setting Powered False 19:56:16.578764 bus /sierra_3: Setting Powered False 19:56:17.693279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:56:18.939025 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:18.945755 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:56:18.978324 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:56:19.004718 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:56:19.058806 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:56:19.091866 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:56:19.118206 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:56:19.667996 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:56:19.716396 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:19.727650 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:56:19.797896 tst mo_mt_call.py: using LAC 31138 19:56:19.925351 tst mo_mt_call.py: using RAC 28 19:56:20.053397 tst mo_mt_call.py: using CellId 31138 19:56:20.181780 tst mo_mt_call.py: using BVCI 31139 19:56:20.300733 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:20.312504 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:20.324551 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:20.336661 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:20.348707 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:20.360613 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:56:20.477165 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:56:20.592631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:21.059819 run create_hlr_db(pid=21611): Launched 19:56:21.184772 bus /sierra_2: Setting Powered False 19:56:22.246096 run create_hlr_db(pid=21611): Terminated: ok {rc=0} 19:56:22.688466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21613): Launched 19:56:23.014472 run osmo-hlr_10.42.42.2(pid=21614): Launched 19:56:23.139989 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:23.696837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21616): Launched 19:56:24.022364 run osmo-stp_10.42.42.5(pid=21617): Launched 19:56:24.145401 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:24.689899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21619): Launched 19:56:24.990879 run osmo-msc_10.42.42.6(pid=21620): Launched 19:56:25.159184 run osmo-stp_10.42.42.5(pid=21617): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21617)] 19:56:25.286449 run osmo-stp_10.42.42.5(pid=21617): stdout: | (launched: 2022-12-12_19:56:23.962661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:25.414183 run osmo-stp_10.42.42.5(pid=21617): stderr: | 20221212195624135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195624135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195624135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195624135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195624136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195624136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195624136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:25.540389 run osmo-stp_10.42.42.5(pid=21617): stdout: | (launched: 2022-12-12_19:56:23.962661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:25.659766 run osmo-stp_10.42.42.5(pid=21617): stderr: | 20221212195624135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195624135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195624135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195624135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195624136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195624136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195624136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:25.803115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21617): Process ended prematurely: osmo-stp_10.42.42.5(pid=21617) [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21617)] [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:56:25.812147 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:56:25.839333 run osmo-hlr_10.42.42.2(pid=21614): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21614)] 19:56:25.888207 run osmo-hlr_10.42.42.2(pid=21614): stdout: | (launched: 2022-12-12_19:56:22.955005) 19:56:25.938613 run osmo-hlr_10.42.42.2(pid=21614): stderr: | 20221212195623152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195623152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195623152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195623152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195623152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195623152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195623163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195623171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195623171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195623171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:26.008622 run osmo-msc_10.42.42.6(pid=21620): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21620)] 19:56:26.057248 run osmo-msc_10.42.42.6(pid=21620): stdout: | (launched: 2022-12-12_19:56:24.935292) 19:56:26.106754 run osmo-msc_10.42.42.6(pid=21620): stderr: | 20221212195625205 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195625205 DLGLOBAL DEBUG validating counter group 0x7fbd953f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195625205 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195625205 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195625205 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195625206 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195625207 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195625208 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195625208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195625208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:26.156586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21613): Terminating (SIGTERM) 19:56:26.196311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21616): Terminating (SIGTERM) 19:56:26.235787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21619): Terminating (SIGTERM) 19:56:26.275502 --- ParallelTerminationStrategy: PID 21613 died... 19:56:26.294737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21613): Terminated: ok {rc=0} 19:56:26.338976 --- ParallelTerminationStrategy: PID 21616 died... 19:56:26.357749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21616): Terminated: ok {rc=0} 19:56:26.401406 --- ParallelTerminationStrategy: PID 21619 died... 19:56:26.420079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21619): Terminated: ok {rc=0} 19:56:26.505653 bus /sierra_3: Setting Powered False 19:56:27.605040 bus /sierra_3: Setting Powered False 19:56:28.718278 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:56:29.866047 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:29.878602 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:56:29.952030 tst mo_mt_call_osmux.py: using LAC 31139 19:56:30.078304 tst mo_mt_call_osmux.py: using RAC 29 19:56:30.206676 tst mo_mt_call_osmux.py: using CellId 31139 19:56:30.333281 tst mo_mt_call_osmux.py: using BVCI 31140 19:56:30.442853 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:30.454261 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:30.465629 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:30.476902 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:30.488363 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:56:30.499724 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:56:30.618538 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:56:30.741463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:31.251092 run create_hlr_db(pid=21623): Launched 19:56:31.409193 bus /sierra_2: Setting Powered False 19:56:32.469980 run create_hlr_db(pid=21623): Terminated: ok {rc=0} 19:56:32.891920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21625): Launched 19:56:33.194859 run osmo-hlr_10.42.42.2(pid=21626): Launched 19:56:33.311590 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:33.833440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21628): Launched 19:56:34.135322 run osmo-stp_10.42.42.5(pid=21629): Launched 19:56:34.249155 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:34.800390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21631): Launched 19:56:35.104486 run osmo-msc_10.42.42.6(pid=21632): Launched 19:56:35.273496 run osmo-stp_10.42.42.5(pid=21629): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21629)] 19:56:35.400719 run osmo-stp_10.42.42.5(pid=21629): stdout: | (launched: 2022-12-12_19:56:34.079348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:35.528221 run osmo-stp_10.42.42.5(pid=21629): stderr: | 20221212195634251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195634251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195634251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195634251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195634252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195634252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195634252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:35.653824 run osmo-stp_10.42.42.5(pid=21629): stdout: | (launched: 2022-12-12_19:56:34.079348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:35.773312 run osmo-stp_10.42.42.5(pid=21629): stderr: | 20221212195634251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195634251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195634251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195634251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195634252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195634252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195634252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:35.916457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21629): Process ended prematurely: osmo-stp_10.42.42.5(pid=21629) [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21629)] [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:56:35.925362 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:56:35.951988 run osmo-hlr_10.42.42.2(pid=21626): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21626)] 19:56:35.999429 run osmo-hlr_10.42.42.2(pid=21626): stdout: | (launched: 2022-12-12_19:56:33.138585) 19:56:36.049409 run osmo-hlr_10.42.42.2(pid=21626): stderr: | 20221212195633312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195633312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195633312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195633312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195633313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195633313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195633325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195633333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195633333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195633334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:36.118456 run osmo-msc_10.42.42.6(pid=21632): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21632)] 19:56:36.165965 run osmo-msc_10.42.42.6(pid=21632): stdout: | (launched: 2022-12-12_19:56:35.048161) 19:56:36.215163 run osmo-msc_10.42.42.6(pid=21632): stderr: | 20221212195635322 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195635322 DLGLOBAL DEBUG validating counter group 0x7fdb7a090c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195635322 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195635322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195635322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195635323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195635325 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195635326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195635326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195635326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:36.264771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21625): Terminating (SIGTERM) 19:56:36.304127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21628): Terminating (SIGTERM) 19:56:36.343870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21631): Terminating (SIGTERM) 19:56:36.383718 --- ParallelTerminationStrategy: PID 21625 died... 19:56:36.402878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21625): Terminated: ok {rc=0} 19:56:36.447383 --- ParallelTerminationStrategy: PID 21628 died... 19:56:36.466092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21628): Terminated: ok {rc=0} 19:56:36.509927 --- ParallelTerminationStrategy: PID 21631 died... 19:56:36.528468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21631): Terminated: ok {rc=0} 19:56:36.612139 bus /sierra_3: Setting Powered False 19:56:37.712051 bus /sierra_3: Setting Powered False 19:56:38.829929 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:56:40.080213 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:40.087848 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:56:40.123772 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:56:40.151788 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:56:40.206726 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:56:40.239426 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:56:40.265522 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:56:40.817137 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:56:40.867602 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:40.878642 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:56:40.948280 tst mo_mt_call.py: using LAC 31140 19:56:41.066755 tst mo_mt_call.py: using RAC 30 19:56:41.188741 tst mo_mt_call.py: using CellId 31140 19:56:41.306507 tst mo_mt_call.py: using BVCI 31141 19:56:41.416831 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:41.427787 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:41.438553 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:41.449206 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:41.459812 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:41.470597 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:56:41.590140 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:56:41.707231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:42.175170 run create_hlr_db(pid=21637): Launched 19:56:42.298321 bus /sierra_2: Setting Powered False 19:56:43.359047 run create_hlr_db(pid=21637): Terminated: ok {rc=0} 19:56:43.780677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21639): Launched 19:56:44.082941 run osmo-hlr_10.42.42.2(pid=21640): Launched 19:56:44.199453 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:44.716715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21642): Launched 19:56:45.017696 run osmo-stp_10.42.42.5(pid=21643): Launched 19:56:45.132495 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:45.678707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21645): Launched 19:56:46.016238 run osmo-msc_10.42.42.6(pid=21646): Launched 19:56:46.444397 run osmo-stp_10.42.42.5(pid=21643): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21643)] 19:56:46.705662 run osmo-stp_10.42.42.5(pid=21643): stdout: | (launched: 2022-12-12_19:56:44.961743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:46.906380 run osmo-stp_10.42.42.5(pid=21643): stderr: | 20221212195645131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195645131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195645131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195645131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195645132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195645132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195645132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:47.034587 run osmo-stp_10.42.42.5(pid=21643): stdout: | (launched: 2022-12-12_19:56:44.961743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:47.157294 run osmo-stp_10.42.42.5(pid=21643): stderr: | 20221212195645131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195645131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195645131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195645131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195645132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195645132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195645132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:47.321092 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21643): Process ended prematurely: osmo-stp_10.42.42.5(pid=21643) [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21643)] [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:56:47.331466 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:56:47.362006 run osmo-hlr_10.42.42.2(pid=21640): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21640)] 19:56:47.414020 run osmo-hlr_10.42.42.2(pid=21640): stdout: | (launched: 2022-12-12_19:56:44.026672) 19:56:47.467898 run osmo-hlr_10.42.42.2(pid=21640): stderr: | 20221212195644206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195644206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195644206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195644206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195644206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195644206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195644216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195644228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195644228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195644228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:47.542986 run osmo-msc_10.42.42.6(pid=21646): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21646)] 19:56:47.594914 run osmo-msc_10.42.42.6(pid=21646): stdout: | (launched: 2022-12-12_19:56:45.959579) 19:56:47.648298 run osmo-msc_10.42.42.6(pid=21646): stderr: | 20221212195646415 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195646415 DLGLOBAL DEBUG validating counter group 0x7f1a32feac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195646415 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195646415 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195646415 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195646416 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195646417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195646418 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195646418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195646418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:47.702101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21639): Terminating (SIGTERM) 19:56:47.745063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21642): Terminating (SIGTERM) 19:56:47.788396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21645): Terminating (SIGTERM) 19:56:47.832307 --- ParallelTerminationStrategy: PID 21639 died... 19:56:47.852916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21639): Terminated: ok {rc=0} 19:56:47.901984 --- ParallelTerminationStrategy: PID 21642 died... 19:56:47.922039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21642): Terminated: ok {rc=0} 19:56:47.971013 --- ParallelTerminationStrategy: PID 21645 died... 19:56:47.991086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21645): Terminated: ok {rc=0} 19:56:48.081862 bus /sierra_3: Setting Powered False 19:56:49.180349 bus /sierra_3: Setting Powered False 19:56:50.297364 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:56:51.444656 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:51.456413 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:56:51.526527 tst mo_mt_call_osmux.py: using LAC 31141 19:56:51.646278 tst mo_mt_call_osmux.py: using RAC 31 19:56:51.765740 tst mo_mt_call_osmux.py: using CellId 31141 19:56:51.894100 tst mo_mt_call_osmux.py: using BVCI 31142 19:56:52.013719 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:52.025325 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:52.036692 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:52.048928 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:52.061471 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:56:52.073717 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:56:52.191084 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:56:52.311387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:52.812250 run create_hlr_db(pid=21648): Launched 19:56:52.937178 bus /sierra_2: Setting Powered False 19:56:54.001351 run create_hlr_db(pid=21648): Terminated: ok {rc=0} 19:56:54.438058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21650): Launched 19:56:54.742746 run osmo-hlr_10.42.42.2(pid=21651): Launched 19:56:54.858134 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:55.378114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21653): Launched 19:56:55.680620 run osmo-stp_10.42.42.5(pid=21654): Launched 19:56:55.795779 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:56.340361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21656): Launched 19:56:56.643195 run osmo-msc_10.42.42.6(pid=21657): Launched 19:56:56.811962 run osmo-stp_10.42.42.5(pid=21654): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21654)] 19:56:56.938652 run osmo-stp_10.42.42.5(pid=21654): stdout: | (launched: 2022-12-12_19:56:55.625066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:57.066030 run osmo-stp_10.42.42.5(pid=21654): stderr: | 20221212195655792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195655792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195655794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195655794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195655795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195655795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195655795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:57.191290 run osmo-stp_10.42.42.5(pid=21654): stdout: | (launched: 2022-12-12_19:56:55.625066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:57.310866 run osmo-stp_10.42.42.5(pid=21654): stderr: | 20221212195655792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195655792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195655794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195655794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195655795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195655795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195655795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:57.454288 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21654): Process ended prematurely: osmo-stp_10.42.42.5(pid=21654) [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21654)] [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:56:57.463011 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:56:57.489725 run osmo-hlr_10.42.42.2(pid=21651): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21651)] 19:56:57.537745 run osmo-hlr_10.42.42.2(pid=21651): stdout: | (launched: 2022-12-12_19:56:54.686879) 19:56:57.587266 run osmo-hlr_10.42.42.2(pid=21651): stderr: | 20221212195654860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195654860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195654860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195654860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195654860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195654860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195654872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195654881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195654881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195654881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:57.656268 run osmo-msc_10.42.42.6(pid=21657): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21657)] 19:56:57.704157 run osmo-msc_10.42.42.6(pid=21657): stdout: | (launched: 2022-12-12_19:56:56.587109) 19:56:57.753817 run osmo-msc_10.42.42.6(pid=21657): stderr: | 20221212195656860 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195656860 DLGLOBAL DEBUG validating counter group 0x7f6f656f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195656860 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195656860 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195656861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195656861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195656863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195656863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195656863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195656863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:57.803603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21650): Terminating (SIGTERM) 19:56:57.843328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21653): Terminating (SIGTERM) 19:56:57.882997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21656): Terminating (SIGTERM) 19:56:57.922884 --- ParallelTerminationStrategy: PID 21650 died... 19:56:57.942087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21650): Terminated: ok {rc=0} 19:56:57.986610 --- ParallelTerminationStrategy: PID 21653 died... 19:56:58.005622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21653): Terminated: ok {rc=0} 19:56:58.051362 --- ParallelTerminationStrategy: PID 21656 died... 19:56:58.070392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21656): Terminated: ok {rc=0} 19:56:58.155624 bus /sierra_3: Setting Powered False 19:56:59.255266 bus /sierra_3: Setting Powered False 19:57:00.373486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:trx-lms --------------------------------------------------------------------- 19:57:01.620005 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:01.625525 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 19:57:01.663867 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:57:01.692309 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 19:57:01.783813 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 19:57:01.832480 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:57:01.870969 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 19:57:02.427218 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 19:57:02.432728 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:02.444068 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 19:57:02.496624 tst emergency_mo_mt_call.py: using LAC 31142 19:57:02.622894 tst emergency_mo_mt_call.py: using RAC 32 19:57:02.752261 tst emergency_mo_mt_call.py: using CellId 31142 19:57:02.875648 tst emergency_mo_mt_call.py: using BVCI 31143 19:57:02.989916 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:03.001087 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:03.012033 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:03.023333 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:03.034538 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:03.045722 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:57:03.160554 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:57:03.276177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:03.736407 run create_hlr_db(pid=21662): Launched 19:57:03.858836 bus /sierra_2: Setting Powered False 19:57:04.918129 run create_hlr_db(pid=21662): Terminated: ok {rc=0} 19:57:05.354530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21664): Launched 19:57:05.675141 run osmo-hlr_10.42.42.2(pid=21665): Launched 19:57:05.798187 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:06.346708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21667): Launched 19:57:06.667311 run osmo-stp_10.42.42.5(pid=21668): Launched 19:57:06.797612 tst emergency_mo_mt_call.py: using MSISDN 7940 19:57:06.960512 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:07.532092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21670): Launched 19:57:07.852665 run osmo-msc_10.42.42.6(pid=21671): Launched 19:57:08.030532 run osmo-stp_10.42.42.5(pid=21668): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21668)] 19:57:08.164402 run osmo-stp_10.42.42.5(pid=21668): stdout: | (launched: 2022-12-12_19:57:06.608282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:08.300285 run osmo-stp_10.42.42.5(pid=21668): stderr: | 20221212195706799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195706799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195706800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195706800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195706801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195706801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195706801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:08.433844 run osmo-stp_10.42.42.5(pid=21668): stdout: | (launched: 2022-12-12_19:57:06.608282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:08.560740 run osmo-stp_10.42.42.5(pid=21668): stderr: | 20221212195706799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195706799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195706800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195706800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195706801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195706801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195706801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:08.712295 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21668): Process ended prematurely: osmo-stp_10.42.42.5(pid=21668) [trial-2381↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21668)] [trial-2381↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 19:57:08.721324 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 19:57:08.749256 run osmo-hlr_10.42.42.2(pid=21665): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21665)] 19:57:08.800314 run osmo-hlr_10.42.42.2(pid=21665): stdout: | (launched: 2022-12-12_19:57:05.616447) 19:57:08.852749 run osmo-hlr_10.42.42.2(pid=21665): stderr: | 20221212195705812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195705812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195705812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195705812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195705812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195705812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195705824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195705833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195705833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195705833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:08.925766 run osmo-msc_10.42.42.6(pid=21671): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21671)] 19:57:08.976577 run osmo-msc_10.42.42.6(pid=21671): stdout: | (launched: 2022-12-12_19:57:07.793905) 19:57:09.028889 run osmo-msc_10.42.42.6(pid=21671): stderr: | 20221212195708114 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195708114 DLGLOBAL DEBUG validating counter group 0x7f9fe3bc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195708114 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195708114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195708115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195708115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195708117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195708117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195708117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195708117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:09.081610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21664): Terminating (SIGTERM) 19:57:09.123862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21667): Terminating (SIGTERM) 19:57:09.166232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21670): Terminating (SIGTERM) 19:57:09.208838 --- ParallelTerminationStrategy: PID 21664 died... 19:57:09.229059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21664): Terminated: ok {rc=0} 19:57:09.276095 --- ParallelTerminationStrategy: PID 21667 died... 19:57:09.295753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21667): Terminated: ok {rc=0} 19:57:09.342752 --- ParallelTerminationStrategy: PID 21670 died... 19:57:09.362515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21670): Terminated: ok {rc=0} 19:57:09.451405 bus /sierra_3: Setting Powered False 19:57:10.551734 bus /sierra_3: Setting Powered False 19:57:11.668903 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 19:57:12.756014 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:12.768148 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 19:57:12.822809 tst emergency_preemptive_call.py: using LAC 31143 19:57:12.948805 tst emergency_preemptive_call.py: using RAC 33 19:57:13.065421 tst emergency_preemptive_call.py: using CellId 31143 19:57:13.181017 tst emergency_preemptive_call.py: using BVCI 31144 19:57:13.287276 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:13.298224 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:13.308867 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:13.319904 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:13.330524 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:57:13.341054 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:57:13.458591 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:57:13.578112 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:57:13.698030 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:57:13.814335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:14.306044 run create_hlr_db(pid=21673): Launched 19:57:14.429381 bus /sierra_2: Setting Powered False 19:57:15.492299 run create_hlr_db(pid=21673): Terminated: ok {rc=0} 19:57:15.956530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21675): Launched 19:57:16.289898 run osmo-hlr_10.42.42.2(pid=21676): Launched 19:57:16.571281 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:17.185483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21678): Launched 19:57:17.518739 run osmo-stp_10.42.42.5(pid=21679): Launched 19:57:17.655781 tst emergency_preemptive_call.py: using MSISDN 7941 19:57:17.822459 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:18.392339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21681): Launched 19:57:18.710368 run osmo-msc_10.42.42.6(pid=21682): Launched 19:57:18.888473 run osmo-stp_10.42.42.5(pid=21679): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21679)] 19:57:19.022812 run osmo-stp_10.42.42.5(pid=21679): stdout: | (launched: 2022-12-12_19:57:17.459942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:19.157301 run osmo-stp_10.42.42.5(pid=21679): stderr: | 20221212195717650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195717650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195717650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195717650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195717651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195717651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195717653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:19.290886 run osmo-stp_10.42.42.5(pid=21679): stdout: | (launched: 2022-12-12_19:57:17.459942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:19.416540 run osmo-stp_10.42.42.5(pid=21679): stderr: | 20221212195717650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195717650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195717650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195717650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195717651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195717651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195717653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:19.567999 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21679): Process ended prematurely: osmo-stp_10.42.42.5(pid=21679) [trial-2381↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21679)] [trial-2381↪emergency:trx-lms↪emergency_preemptive_call.py:32] 19:57:19.577155 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 19:57:19.605307 run osmo-hlr_10.42.42.2(pid=21676): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21676)] 19:57:19.656428 run osmo-hlr_10.42.42.2(pid=21676): stdout: | (launched: 2022-12-12_19:57:16.230750) 19:57:19.708845 run osmo-hlr_10.42.42.2(pid=21676): stderr: | 20221212195716456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195716456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195716456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195716456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195716456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195716456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195716475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195716483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195716483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195716483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:19.781906 run osmo-msc_10.42.42.6(pid=21682): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21682)] 19:57:19.832668 run osmo-msc_10.42.42.6(pid=21682): stdout: | (launched: 2022-12-12_19:57:18.651977) 19:57:19.885105 run osmo-msc_10.42.42.6(pid=21682): stderr: | 20221212195718970 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212195718970 DLGLOBAL DEBUG validating counter group 0x7fb94411bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212195718971 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212195718971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212195718971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212195718971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212195718973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212195718973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212195718973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212195718973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:19.937887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21675): Terminating (SIGTERM) 19:57:19.980304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21678): Terminating (SIGTERM) 19:57:20.022863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21681): Terminating (SIGTERM) 19:57:20.065474 --- ParallelTerminationStrategy: PID 21675 died... 19:57:20.085683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21675): Terminated: ok {rc=0} 19:57:20.132773 --- ParallelTerminationStrategy: PID 21678 died... 19:57:20.152638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21678): Terminated: ok {rc=0} 19:57:20.199451 --- ParallelTerminationStrategy: PID 21681 died... 19:57:20.219253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21681): Terminated: ok {rc=0} 19:57:20.308660 bus /sierra_9: Setting Powered False 19:57:21.406446 bus /sierra_9: Setting Powered False 19:57:22.523304 bus /sierra_8: Setting Powered False 19:57:23.621675 bus /sierra_8: Setting Powered False 19:57:24.738482 bus /sierra_3: Setting Powered False 19:57:25.834500 bus /sierra_3: Setting Powered False 19:57:26.951387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms --------------------------------------------------------------------- 19:57:28.229369 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:28.233596 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 19:57:28.266360 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 19:57:28.304347 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 19:57:28.390250 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 19:57:28.422892 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 19:57:28.461554 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 19:57:29.050069 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 19:57:29.099045 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.109597 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:57:29.157218 tst cs_paging_gprs_active.py: using LAC 31144 19:57:29.275713 tst cs_paging_gprs_active.py: using RAC 34 19:57:29.392319 tst cs_paging_gprs_active.py: using CellId 31144 19:57:29.512010 tst cs_paging_gprs_active.py: using BVCI 31145 19:57:29.620705 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.631386 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.641794 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.652092 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.662435 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.672659 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.683079 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.693306 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:29.703718 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:57:29.821635 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:57:29.939587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:57:30.141717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:57:30.445092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21687): Launched 19:57:30.709238 run iperf3-srv_10.42.42.10(pid=21688): Launched 19:57:30.822532 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:57:31.063631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:57:31.381839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21689): Launched 19:57:31.654065 run iperf3-srv_10.42.42.10(pid=21690): Launched 19:57:31.783616 tst cs_paging_gprs_active.py:38: start network... 19:57:31.988012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:32.455662 run create_hlr_db(pid=21691): Launched 19:57:32.571241 bus /sierra_2: Setting Powered False 19:57:33.631035 run create_hlr_db(pid=21691): Terminated: ok {rc=0} 19:57:34.075109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21693): Launched 19:57:34.402207 run osmo-hlr_10.42.42.2(pid=21694): Launched 19:57:34.527947 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:35.086485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21696): Launched 19:57:35.410531 run osmo-stp_10.42.42.5(pid=21697): Launched 19:57:35.535340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:57:36.092006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21699): Launched 19:57:36.218512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:57:36.492103 run patchelf(pid=21700): Launched 19:57:36.674754 run osmo-stp_10.42.42.5(pid=21697): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21697)] 19:57:36.811854 run osmo-stp_10.42.42.5(pid=21697): stdout: | (launched: 2022-12-12_19:57:35.351140) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:36.950580 run osmo-stp_10.42.42.5(pid=21697): stderr: | 20221212195735542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195735542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195735542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195735543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195735543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195735543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195735543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:37.089126 run osmo-stp_10.42.42.5(pid=21697): stdout: | (launched: 2022-12-12_19:57:35.351140) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:37.220931 run osmo-stp_10.42.42.5(pid=21697): stderr: | 20221212195735542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195735542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195735542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195735543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195735543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195735543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195735543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:37.377548 run patchelf(pid=21700): Terminating (SIGINT) 19:57:37.558531 run patchelf(pid=21700): Terminated: ok {rc=0} 19:57:37.689185 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21697): Process ended prematurely: osmo-stp_10.42.42.5(pid=21697) [trial-2381↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21697)] [trial-2381↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 19:57:37.699350 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:57:37.728495 run osmo-hlr_10.42.42.2(pid=21694): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21694)] 19:57:37.778873 run osmo-hlr_10.42.42.2(pid=21694): stdout: | (launched: 2022-12-12_19:57:34.342300) 19:57:37.831362 run osmo-hlr_10.42.42.2(pid=21694): stderr: | 20221212195734539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195734539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195734539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195734539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195734540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195734540 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195734552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195734561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195734561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195734561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:37.884360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21687): Terminating (SIGTERM) 19:57:37.926574 run iperf3-srv_10.42.42.10(pid=21688): Terminating (SIGTERM) 19:57:37.968521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21689): Terminating (SIGTERM) 19:57:38.010850 run iperf3-srv_10.42.42.10(pid=21690): Terminating (SIGTERM) 19:57:38.052745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21693): Terminating (SIGTERM) 19:57:38.095457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21696): Terminating (SIGTERM) 19:57:38.137838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21699): Terminating (SIGTERM) 19:57:38.180115 --- ParallelTerminationStrategy: PID 21687 died... 19:57:38.200106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21687): Terminated: ok {rc=0} 19:57:38.247460 --- ParallelTerminationStrategy: PID 21688 died... 19:57:38.267140 run iperf3-srv_10.42.42.10(pid=21688): Terminated {rc=256} 19:57:38.313966 --- ParallelTerminationStrategy: PID 21689 died... 19:57:38.333871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21689): Terminated: ok {rc=0} 19:57:38.381245 --- ParallelTerminationStrategy: PID 21690 died... 19:57:38.400682 run iperf3-srv_10.42.42.10(pid=21690): Terminated {rc=256} 19:57:38.447684 --- ParallelTerminationStrategy: PID 21693 died... 19:57:38.467427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21693): Terminated: ok {rc=0} 19:57:38.514335 --- ParallelTerminationStrategy: PID 21696 died... 19:57:38.534073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21696): Terminated: ok {rc=0} 19:57:38.581144 --- ParallelTerminationStrategy: PID 21699 died... 19:57:38.600819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21699): Terminated: ok {rc=0} 19:57:38.689239 bus /gobi_0: Setting Powered False 19:57:39.788532 bus /gobi_0: Setting Powered False 19:57:40.905877 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms iperf3.py ---------------------------------------------- 19:57:42.054762 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.066763 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:57:42.120763 tst iperf3.py: using LAC 31145 19:57:42.247097 tst iperf3.py: using RAC 35 19:57:42.372697 tst iperf3.py: using CellId 31145 19:57:42.500322 tst iperf3.py: using BVCI 31146 19:57:42.618050 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.629193 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.640092 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.651277 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.662432 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.674206 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.685865 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.696795 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:42.708360 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:57:42.824210 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:57:43.026620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:57:43.329237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21701): Launched 19:57:43.594233 run iperf3-srv_10.42.42.10(pid=21702): Launched 19:57:43.709257 tst iperf3.py:8: start network... 19:57:43.909322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:44.373254 run create_hlr_db(pid=21703): Launched 19:57:44.497322 bus /gobi_6: Setting Powered False 19:57:45.557562 run create_hlr_db(pid=21703): Terminated: ok {rc=0} 19:57:45.985535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21705): Launched 19:57:46.300078 run osmo-hlr_10.42.42.2(pid=21706): Launched 19:57:46.532585 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:47.213798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21708): Launched 19:57:47.541588 run osmo-stp_10.42.42.5(pid=21709): Launched 19:57:47.668039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:57:48.224812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21711): Launched 19:57:48.351128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:57:48.625444 run patchelf(pid=21712): Launched 19:57:48.806925 run osmo-stp_10.42.42.5(pid=21709): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21709)] 19:57:48.944395 run osmo-stp_10.42.42.5(pid=21709): stdout: | (launched: 2022-12-12_19:57:47.481777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:49.083187 run osmo-stp_10.42.42.5(pid=21709): stderr: | 20221212195747672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195747672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195747673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195747673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195747673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195747674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195747674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:49.222601 run osmo-stp_10.42.42.5(pid=21709): stdout: | (launched: 2022-12-12_19:57:47.481777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:49.355699 run osmo-stp_10.42.42.5(pid=21709): stderr: | 20221212195747672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195747672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195747673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195747673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195747673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195747674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195747674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:49.512881 run patchelf(pid=21712): Terminating (SIGINT) 19:57:49.694494 run patchelf(pid=21712): Terminated: ok {rc=0} 19:57:49.825103 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21709): Process ended prematurely: osmo-stp_10.42.42.5(pid=21709) [trial-2381↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21709)] [trial-2381↪gprs:trx-lms↪iperf3.py:8] 19:57:49.835439 tst iperf3.py:8: Test FAILED (7.8 sec) 19:57:49.864940 run osmo-hlr_10.42.42.2(pid=21706): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21706)] 19:57:49.915592 run osmo-hlr_10.42.42.2(pid=21706): stdout: | (launched: 2022-12-12_19:57:46.242899) 19:57:49.968126 run osmo-hlr_10.42.42.2(pid=21706): stderr: | 20221212195746549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195746549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195746549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195746549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195746549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195746550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195746563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195746580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195746580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195746580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:50.021233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21701): Terminating (SIGTERM) 19:57:50.063540 run iperf3-srv_10.42.42.10(pid=21702): Terminating (SIGTERM) 19:57:50.105701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21705): Terminating (SIGTERM) 19:57:50.147799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21708): Terminating (SIGTERM) 19:57:50.190062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21711): Terminating (SIGTERM) 19:57:50.232590 --- ParallelTerminationStrategy: PID 21701 died... 19:57:50.252811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21701): Terminated: ok {rc=0} 19:57:50.300022 --- ParallelTerminationStrategy: PID 21702 died... 19:57:50.319899 run iperf3-srv_10.42.42.10(pid=21702): Terminated {rc=256} 19:57:50.366671 --- ParallelTerminationStrategy: PID 21705 died... 19:57:50.386396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21705): Terminated: ok {rc=0} 19:57:50.433421 --- ParallelTerminationStrategy: PID 21708 died... 19:57:50.453127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21708): Terminated: ok {rc=0} 19:57:50.499927 --- ParallelTerminationStrategy: PID 21711 died... 19:57:50.519769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21711): Terminated: ok {rc=0} 19:57:50.609920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms iperf3m4.py ---------------------------------------------- 19:57:51.760533 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:51.772473 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:57:51.822355 tst iperf3m4.py: using LAC 31146 19:57:51.953138 tst iperf3m4.py: using RAC 36 19:57:52.077522 tst iperf3m4.py: using CellId 31146 19:57:52.204181 tst iperf3m4.py: using BVCI 31147 19:57:52.320432 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.331720 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.342734 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.354010 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.365171 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.376316 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.387850 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.399052 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:57:52.410408 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:57:52.530845 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:57:52.654760 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:57:52.774317 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:57:52.891317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:57:53.093794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:57:53.397303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21713): Launched 19:57:53.661613 run iperf3-srv_10.42.42.10(pid=21714): Launched 19:57:53.774408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:57:53.975189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:57:54.277617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21715): Launched 19:57:54.540810 run iperf3-srv_10.42.42.10(pid=21716): Launched 19:57:54.654731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:57:54.855468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:57:55.158524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21717): Launched 19:57:55.423065 run iperf3-srv_10.42.42.10(pid=21718): Launched 19:57:55.537621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:57:55.737554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:57:56.039545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21719): Launched 19:57:56.303176 run iperf3-srv_10.42.42.10(pid=21720): Launched 19:57:56.418049 tst iperf3m4.py:8: start network... 19:57:56.618882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:57.085595 run create_hlr_db(pid=21721): Launched 19:57:57.209762 bus /gobi_6: Setting Powered False 19:57:58.269764 run create_hlr_db(pid=21721): Terminated: ok {rc=0} 19:57:58.712792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21723): Launched 19:57:59.038712 run osmo-hlr_10.42.42.2(pid=21724): Launched 19:57:59.164189 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:59.726021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21726): Launched 19:58:00.050615 run osmo-stp_10.42.42.5(pid=21727): Launched 19:58:00.175291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:58:00.732266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21729): Launched 19:58:00.874671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:58:01.157885 run patchelf(pid=21730): Launched 19:58:01.342792 run osmo-stp_10.42.42.5(pid=21727): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21727)] 19:58:01.484026 run osmo-stp_10.42.42.5(pid=21727): stdout: | (launched: 2022-12-12_19:57:59.990364) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:01.628277 run osmo-stp_10.42.42.5(pid=21727): stderr: | 20221212195800180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195800180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195800181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195800181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195800181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195800182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195800182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:01.771328 run osmo-stp_10.42.42.5(pid=21727): stdout: | (launched: 2022-12-12_19:57:59.990364) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:01.907772 run osmo-stp_10.42.42.5(pid=21727): stderr: | 20221212195800180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195800180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195800181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195800181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195800181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195800182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195800182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:02.069586 run patchelf(pid=21730): Terminating (SIGINT) 19:58:02.252539 run patchelf(pid=21730): Terminated: ok {rc=0} 19:58:02.383742 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21727): Process ended prematurely: osmo-stp_10.42.42.5(pid=21727) [trial-2381↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21727)] [trial-2381↪gprs:trx-lms↪iperf3m4.py:8] 19:58:02.394364 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:58:02.424402 run osmo-hlr_10.42.42.2(pid=21724): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21724)] 19:58:02.475427 run osmo-hlr_10.42.42.2(pid=21724): stdout: | (launched: 2022-12-12_19:57:58.978910) 19:58:02.528149 run osmo-hlr_10.42.42.2(pid=21724): stderr: | 20221212195759177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195759177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195759177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195759177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195759177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195759177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195759191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195759199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195759199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195759199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:02.581466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21713): Terminating (SIGTERM) 19:58:02.623776 run iperf3-srv_10.42.42.10(pid=21714): Terminating (SIGTERM) 19:58:02.666234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21715): Terminating (SIGTERM) 19:58:02.708479 run iperf3-srv_10.42.42.10(pid=21716): Terminating (SIGTERM) 19:58:02.750853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21717): Terminating (SIGTERM) 19:58:02.793191 run iperf3-srv_10.42.42.10(pid=21718): Terminating (SIGTERM) 19:58:02.835608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21719): Terminating (SIGTERM) 19:58:02.878060 run iperf3-srv_10.42.42.10(pid=21720): Terminating (SIGTERM) 19:58:02.920159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21723): Terminating (SIGTERM) 19:58:02.962561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21726): Terminating (SIGTERM) 19:58:03.004809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21729): Terminating (SIGTERM) 19:58:03.047657 --- ParallelTerminationStrategy: PID 21713 died... 19:58:03.067997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21713): Terminated: ok {rc=0} 19:58:03.115849 --- ParallelTerminationStrategy: PID 21714 died... 19:58:03.135957 run iperf3-srv_10.42.42.10(pid=21714): Terminated {rc=256} 19:58:03.183178 --- ParallelTerminationStrategy: PID 21715 died... 19:58:03.203060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21715): Terminated: ok {rc=0} 19:58:03.250270 --- ParallelTerminationStrategy: PID 21716 died... 19:58:03.270237 run iperf3-srv_10.42.42.10(pid=21716): Terminated {rc=256} 19:58:03.317738 --- ParallelTerminationStrategy: PID 21717 died... 19:58:03.337755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21717): Terminated: ok {rc=0} 19:58:03.385446 --- ParallelTerminationStrategy: PID 21718 died... 19:58:03.405523 run iperf3-srv_10.42.42.10(pid=21718): Terminated {rc=256} 19:58:03.453234 --- ParallelTerminationStrategy: PID 21719 died... 19:58:03.472878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21719): Terminated: ok {rc=0} 19:58:03.520665 --- ParallelTerminationStrategy: PID 21720 died... 19:58:03.540673 run iperf3-srv_10.42.42.10(pid=21720): Terminated {rc=256} 19:58:03.588506 --- ParallelTerminationStrategy: PID 21723 died... 19:58:03.608611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21723): Terminated: ok {rc=0} 19:58:03.655997 --- ParallelTerminationStrategy: PID 21726 died... 19:58:03.676008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21726): Terminated: ok {rc=0} 19:58:03.723521 --- ParallelTerminationStrategy: PID 21729 died... 19:58:03.743555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21729): Terminated: ok {rc=0} 19:58:03.833352 bus /gobi_4: Setting Powered False 19:58:04.933542 bus /gobi_4: Setting Powered False 19:58:06.052221 bus /gobi_1: Setting Powered False 19:58:07.151349 bus /gobi_1: Setting Powered False 19:58:08.270645 bus /gobi_0: Setting Powered False 19:58:09.370362 bus /gobi_0: Setting Powered False 19:58:10.487304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms ping.py ---------------------------------------------- 19:58:11.591325 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:11.602652 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:58:11.652569 tst ping.py: using LAC 31147 19:58:11.769505 tst ping.py: using RAC 37 19:58:11.894675 tst ping.py: using CellId 31147 19:58:12.018441 tst ping.py: using BVCI 31148 19:58:12.134968 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:12.146227 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:12.157379 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:12.168592 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:12.179769 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:12.190854 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:12.202110 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:12.213318 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:58:12.328524 tst ping.py:19: start network... 19:58:12.525717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:12.982913 run create_hlr_db(pid=21731): Launched 19:58:13.106812 bus /gobi_6: Setting Powered False 19:58:14.166591 run create_hlr_db(pid=21731): Terminated: ok {rc=0} 19:58:14.602279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21733): Launched 19:58:14.922044 run osmo-hlr_10.42.42.2(pid=21734): Launched 19:58:15.044295 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:15.600256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21736): Launched 19:58:15.931730 run osmo-stp_10.42.42.5(pid=21737): Launched 19:58:16.171504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:58:16.829041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21739): Launched 19:58:16.958923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:58:17.217993 run patchelf(pid=21740): Launched 19:58:17.383845 run osmo-stp_10.42.42.5(pid=21737): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21737)] 19:58:17.509796 run osmo-stp_10.42.42.5(pid=21737): stdout: | (launched: 2022-12-12_19:58:15.867019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:17.638039 run osmo-stp_10.42.42.5(pid=21737): stderr: | 20221212195816203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195816203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195816203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195816204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195816204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195816204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195816204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:17.765855 run osmo-stp_10.42.42.5(pid=21737): stdout: | (launched: 2022-12-12_19:58:15.867019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:17.887474 run osmo-stp_10.42.42.5(pid=21737): stderr: | 20221212195816203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195816203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195816203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195816204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195816204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195816204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195816204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:18.031516 run patchelf(pid=21740): Terminating (SIGINT) 19:58:18.197350 run patchelf(pid=21740): Terminated: ok {rc=0} 19:58:18.316551 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21737): Process ended prematurely: osmo-stp_10.42.42.5(pid=21737) [trial-2381↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21737)] [trial-2381↪gprs:trx-lms↪ping.py:22] 19:58:18.325632 tst ping.py:22: Test FAILED (6.7 sec) 19:58:18.352739 run osmo-hlr_10.42.42.2(pid=21734): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21734)] 19:58:18.401256 run osmo-hlr_10.42.42.2(pid=21734): stdout: | (launched: 2022-12-12_19:58:14.863727) 19:58:18.451548 run osmo-hlr_10.42.42.2(pid=21734): stderr: | 20221212195815061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195815061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195815061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195815061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195815061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195815061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195815073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195815082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195815082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195815082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:18.502180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21733): Terminating (SIGTERM) 19:58:18.542498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21736): Terminating (SIGTERM) 19:58:18.582817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21739): Terminating (SIGTERM) 19:58:18.623359 --- ParallelTerminationStrategy: PID 21733 died... 19:58:18.642792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21733): Terminated: ok {rc=0} 19:58:18.687417 --- ParallelTerminationStrategy: PID 21736 died... 19:58:18.706307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21736): Terminated: ok {rc=0} 19:58:18.751281 --- ParallelTerminationStrategy: PID 21739 died... 19:58:18.770107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21739): Terminated: ok {rc=0} 19:58:18.856768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 19:58:19.946739 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:19.959006 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:58:20.008748 tst ping_idle_ping.py: using LAC 31148 19:58:20.125528 tst ping_idle_ping.py: using RAC 38 19:58:20.254305 tst ping_idle_ping.py: using CellId 31148 19:58:20.380134 tst ping_idle_ping.py: using BVCI 31149 19:58:20.495862 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:20.507181 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:20.518463 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:20.529891 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:20.541220 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:20.552381 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:20.564113 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:58:20.575480 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:58:20.695345 tst ping_idle_ping.py:24: start network... 19:58:20.910471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:21.407236 run create_hlr_db(pid=21742): Launched 19:58:21.530914 bus /gobi_6: Setting Powered False 19:58:22.594858 run create_hlr_db(pid=21742): Terminated: ok {rc=0} 19:58:23.025216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21744): Launched 19:58:23.323733 run osmo-hlr_10.42.42.2(pid=21745): Launched 19:58:23.437722 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:23.950586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21747): Launched 19:58:24.248497 run osmo-stp_10.42.42.5(pid=21748): Launched 19:58:24.362765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:58:24.875710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21750): Launched 19:58:24.990077 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:58:25.242150 run patchelf(pid=21751): Launched 19:58:25.407940 run osmo-stp_10.42.42.5(pid=21748): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21748)] 19:58:25.532770 run osmo-stp_10.42.42.5(pid=21748): stdout: | (launched: 2022-12-12_19:58:24.193379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:25.659681 run osmo-stp_10.42.42.5(pid=21748): stderr: | 20221212195824361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195824362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195824362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195824362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195824363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195824363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195824363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:25.786638 run osmo-stp_10.42.42.5(pid=21748): stdout: | (launched: 2022-12-12_19:58:24.193379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:25.907776 run osmo-stp_10.42.42.5(pid=21748): stderr: | 20221212195824361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195824362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195824362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195824362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195824363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195824363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195824363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:26.051100 run patchelf(pid=21751): Terminating (SIGINT) 19:58:26.216618 run patchelf(pid=21751): Terminated: ok {rc=0} 19:58:26.335645 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21748): Process ended prematurely: osmo-stp_10.42.42.5(pid=21748) [trial-2381↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21748)] [trial-2381↪gprs:trx-lms↪ping_idle_ping.py:27] 19:58:26.344695 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:58:26.371613 run osmo-hlr_10.42.42.2(pid=21745): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21745)] 19:58:26.419439 run osmo-hlr_10.42.42.2(pid=21745): stdout: | (launched: 2022-12-12_19:58:23.268279) 19:58:26.468779 run osmo-hlr_10.42.42.2(pid=21745): stderr: | 20221212195823445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195823445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195823445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195823445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195823445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195823445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195823457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195823466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195823466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195823466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:26.518531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21744): Terminating (SIGTERM) 19:58:26.558151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21747): Terminating (SIGTERM) 19:58:26.597803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21750): Terminating (SIGTERM) 19:58:26.638742 --- ParallelTerminationStrategy: PID 21744 died... 19:58:26.657882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21744): Terminated: ok {rc=0} 19:58:26.701855 --- ParallelTerminationStrategy: PID 21747 died... 19:58:26.720551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21747): Terminated: ok {rc=0} 19:58:26.764153 --- ParallelTerminationStrategy: PID 21750 died... 19:58:26.782792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21750): Terminated: ok {rc=0} 19:58:26.869493 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 19:58:28.170388 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:28.177458 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:58:28.213839 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:58:28.253860 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:58:28.344144 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:58:28.378510 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:58:28.418187 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:58:29.013233 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:58:29.066216 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.077742 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:58:29.130690 tst cs_paging_gprs_active.py: using LAC 31149 19:58:29.250681 tst cs_paging_gprs_active.py: using RAC 39 19:58:29.371643 tst cs_paging_gprs_active.py: using CellId 31149 19:58:29.492307 tst cs_paging_gprs_active.py: using BVCI 31150 19:58:29.602185 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.613335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.623926 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.634661 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.645222 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.656036 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.666857 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.677402 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:29.688167 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:58:29.806837 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:58:29.922588 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:58:30.125231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:58:30.429767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21755): Launched 19:58:30.694398 run iperf3-srv_10.42.42.10(pid=21756): Launched 19:58:30.809593 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:58:31.038290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:58:31.348861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21757): Launched 19:58:31.631078 run iperf3-srv_10.42.42.10(pid=21758): Launched 19:58:31.760528 tst cs_paging_gprs_active.py:38: start network... 19:58:31.965610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:32.435926 run create_hlr_db(pid=21759): Launched 19:58:32.560011 bus /gobi_6: Setting Powered False 19:58:33.619841 run create_hlr_db(pid=21759): Terminated: ok {rc=0} 19:58:34.062969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21761): Launched 19:58:34.389123 run osmo-hlr_10.42.42.2(pid=21762): Launched 19:58:34.514591 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:35.072020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21764): Launched 19:58:35.399104 run osmo-stp_10.42.42.5(pid=21765): Launched 19:58:35.525299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:58:36.086856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21767): Launched 19:58:36.213282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:58:36.488378 run patchelf(pid=21768): Launched 19:58:36.673206 run osmo-stp_10.42.42.5(pid=21765): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21765)] 19:58:36.810977 run osmo-stp_10.42.42.5(pid=21765): stdout: | (launched: 2022-12-12_19:58:35.339398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:36.950812 run osmo-stp_10.42.42.5(pid=21765): stderr: | 20221212195835530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195835530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195835530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195835530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195835531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195835531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195835531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:37.090925 run osmo-stp_10.42.42.5(pid=21765): stdout: | (launched: 2022-12-12_19:58:35.339398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:37.224048 run osmo-stp_10.42.42.5(pid=21765): stderr: | 20221212195835530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195835530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195835530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195835530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195835531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195835531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195835531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:37.382368 run patchelf(pid=21768): Terminating (SIGINT) 19:58:37.564699 run patchelf(pid=21768): Terminated: ok {rc=0} 19:58:37.696254 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21765): Process ended prematurely: osmo-stp_10.42.42.5(pid=21765) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21765)] [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:58:37.706541 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:58:37.735598 run osmo-hlr_10.42.42.2(pid=21762): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21762)] 19:58:37.786742 run osmo-hlr_10.42.42.2(pid=21762): stdout: | (launched: 2022-12-12_19:58:34.329331) 19:58:37.839914 run osmo-hlr_10.42.42.2(pid=21762): stderr: | 20221212195834527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195834527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195834527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195834527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195834527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195834527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195834540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195834550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195834550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195834550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:37.893182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21755): Terminating (SIGTERM) 19:58:37.935560 run iperf3-srv_10.42.42.10(pid=21756): Terminating (SIGTERM) 19:58:37.977932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21757): Terminating (SIGTERM) 19:58:38.020299 run iperf3-srv_10.42.42.10(pid=21758): Terminating (SIGTERM) 19:58:38.062471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21761): Terminating (SIGTERM) 19:58:38.104811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21764): Terminating (SIGTERM) 19:58:38.147268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21767): Terminating (SIGTERM) 19:58:38.189910 --- ParallelTerminationStrategy: PID 21755 died... 19:58:38.210196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21755): Terminated: ok {rc=0} 19:58:38.257892 --- ParallelTerminationStrategy: PID 21756 died... 19:58:38.277827 run iperf3-srv_10.42.42.10(pid=21756): Terminated {rc=256} 19:58:38.325259 --- ParallelTerminationStrategy: PID 21757 died... 19:58:38.345338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21757): Terminated: ok {rc=0} 19:58:38.392654 --- ParallelTerminationStrategy: PID 21758 died... 19:58:38.412598 run iperf3-srv_10.42.42.10(pid=21758): Terminated {rc=256} 19:58:38.459963 --- ParallelTerminationStrategy: PID 21761 died... 19:58:38.479996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21761): Terminated: ok {rc=0} 19:58:38.527718 --- ParallelTerminationStrategy: PID 21764 died... 19:58:38.547793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21764): Terminated: ok {rc=0} 19:58:38.595511 --- ParallelTerminationStrategy: PID 21767 died... 19:58:38.615524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21767): Terminated: ok {rc=0} 19:58:38.705507 bus /gobi_0: Setting Powered False 19:58:39.805484 bus /gobi_0: Setting Powered False 19:58:40.925196 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:58:42.072240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.083758 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:58:42.135304 tst iperf3.py: using LAC 31150 19:58:42.255898 tst iperf3.py: using RAC 40 19:58:42.375861 tst iperf3.py: using CellId 31150 19:58:42.493558 tst iperf3.py: using BVCI 31151 19:58:42.602722 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.613708 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.624401 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.635192 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.645890 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.656452 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.667298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.678148 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:42.688938 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:58:42.806799 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:58:43.025753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:58:43.352092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Launched 19:58:43.635332 run iperf3-srv_10.42.42.10(pid=21770): Launched 19:58:43.758731 tst iperf3.py:8: start network... 19:58:43.976468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:44.477400 run create_hlr_db(pid=21771): Launched 19:58:44.603232 bus /gobi_6: Setting Powered False 19:58:45.667302 run create_hlr_db(pid=21771): Terminated: ok {rc=0} 19:58:46.115393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21773): Launched 19:58:46.458619 run osmo-hlr_10.42.42.2(pid=21774): Launched 19:58:46.642511 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:47.326914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21776): Launched 19:58:47.652884 run osmo-stp_10.42.42.5(pid=21777): Launched 19:58:47.777517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:58:48.335537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21779): Launched 19:58:48.461477 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:58:48.735617 run patchelf(pid=21780): Launched 19:58:48.917931 run osmo-stp_10.42.42.5(pid=21777): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21777)] 19:58:49.055264 run osmo-stp_10.42.42.5(pid=21777): stdout: | (launched: 2022-12-12_19:58:47.592921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:49.194814 run osmo-stp_10.42.42.5(pid=21777): stderr: | 20221212195847784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195847784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195847785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195847785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195847785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195847786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195847786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:49.333905 run osmo-stp_10.42.42.5(pid=21777): stdout: | (launched: 2022-12-12_19:58:47.592921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:49.466581 run osmo-stp_10.42.42.5(pid=21777): stderr: | 20221212195847784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195847784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195847785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195847785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195847785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195847786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195847786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:49.624010 run patchelf(pid=21780): Terminating (SIGINT) 19:58:49.805026 run patchelf(pid=21780): Terminated: ok {rc=0} 19:58:49.936031 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21777): Process ended prematurely: osmo-stp_10.42.42.5(pid=21777) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21777)] [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 19:58:49.946249 tst iperf3.py:8: Test FAILED (7.9 sec) 19:58:49.975751 run osmo-hlr_10.42.42.2(pid=21774): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21774)] 19:58:50.027029 run osmo-hlr_10.42.42.2(pid=21774): stdout: | (launched: 2022-12-12_19:58:46.398732) 19:58:50.080077 run osmo-hlr_10.42.42.2(pid=21774): stderr: | 20221212195846734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195846734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195846734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195846734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195846734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195846734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195846746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195846754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195846754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195846754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:50.133653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Terminating (SIGTERM) 19:58:50.176215 run iperf3-srv_10.42.42.10(pid=21770): Terminating (SIGTERM) 19:58:50.218893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21773): Terminating (SIGTERM) 19:58:50.261646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21776): Terminating (SIGTERM) 19:58:50.304513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21779): Terminating (SIGTERM) 19:58:50.347616 --- ParallelTerminationStrategy: PID 21769 died... 19:58:50.368013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21769): Terminated: ok {rc=0} 19:58:50.415828 --- ParallelTerminationStrategy: PID 21770 died... 19:58:50.435856 run iperf3-srv_10.42.42.10(pid=21770): Terminated {rc=256} 19:58:50.483224 --- ParallelTerminationStrategy: PID 21773 died... 19:58:50.503214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21773): Terminated: ok {rc=0} 19:58:50.550644 --- ParallelTerminationStrategy: PID 21776 died... 19:58:50.570532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21776): Terminated: ok {rc=0} 19:58:50.618281 --- ParallelTerminationStrategy: PID 21779 died... 19:58:50.638385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21779): Terminated: ok {rc=0} 19:58:50.728771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:58:51.882049 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:51.894299 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:58:51.947511 tst iperf3m4.py: using LAC 31151 19:58:52.076019 tst iperf3m4.py: using RAC 41 19:58:52.205904 tst iperf3m4.py: using CellId 31151 19:58:52.334770 tst iperf3m4.py: using BVCI 31152 19:58:52.454020 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.465595 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.476763 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.488512 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.500107 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.511837 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.523704 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.535282 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:58:52.547228 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:58:52.667652 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:58:52.785488 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:58:52.906143 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:58:53.022879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:58:53.226749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:58:53.530702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21781): Launched 19:58:53.796718 run iperf3-srv_10.42.42.10(pid=21782): Launched 19:58:53.910986 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:58:54.112004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:58:54.416221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21783): Launched 19:58:54.680886 run iperf3-srv_10.42.42.10(pid=21784): Launched 19:58:54.794062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:58:54.995037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:58:55.300248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21785): Launched 19:58:55.564656 run iperf3-srv_10.42.42.10(pid=21786): Launched 19:58:55.678127 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:58:55.879397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:58:56.182607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21787): Launched 19:58:56.448699 run iperf3-srv_10.42.42.10(pid=21788): Launched 19:58:56.562501 tst iperf3m4.py:8: start network... 19:58:56.763431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:57.231814 run create_hlr_db(pid=21789): Launched 19:58:57.357994 bus /gobi_6: Setting Powered False 19:58:58.419005 run create_hlr_db(pid=21789): Terminated: ok {rc=0} 19:58:58.862591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21791): Launched 19:58:59.189895 run osmo-hlr_10.42.42.2(pid=21792): Launched 19:58:59.315640 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:59.878515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21794): Launched 19:59:00.205255 run osmo-stp_10.42.42.5(pid=21795): Launched 19:59:00.328937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:59:00.902008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21797): Launched 19:59:01.032201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:59:01.317821 run patchelf(pid=21798): Launched 19:59:01.496808 run osmo-stp_10.42.42.5(pid=21795): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21795)] 19:59:01.630810 run osmo-stp_10.42.42.5(pid=21795): stdout: | (launched: 2022-12-12_19:59:00.145208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:01.765318 run osmo-stp_10.42.42.5(pid=21795): stderr: | 20221212195900335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195900335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195900335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195900336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195900336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195900336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195900336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:01.901305 run osmo-stp_10.42.42.5(pid=21795): stdout: | (launched: 2022-12-12_19:59:00.145208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:02.030548 run osmo-stp_10.42.42.5(pid=21795): stderr: | 20221212195900335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195900335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195900335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195900336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195900336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195900336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195900336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:02.183051 run patchelf(pid=21798): Terminating (SIGINT) 19:59:02.355385 run patchelf(pid=21798): Terminated: ok {rc=0} 19:59:02.478194 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21795): Process ended prematurely: osmo-stp_10.42.42.5(pid=21795) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21795)] [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 19:59:02.487894 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:59:02.516539 run osmo-hlr_10.42.42.2(pid=21792): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21792)] 19:59:02.565734 run osmo-hlr_10.42.42.2(pid=21792): stdout: | (launched: 2022-12-12_19:58:59.129581) 19:59:02.616612 run osmo-hlr_10.42.42.2(pid=21792): stderr: | 20221212195859330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195859330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195859330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195859330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195859330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195859330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195859342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195859350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195859351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195859351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:02.667684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21781): Terminating (SIGTERM) 19:59:02.708549 run iperf3-srv_10.42.42.10(pid=21782): Terminating (SIGTERM) 19:59:02.749276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21783): Terminating (SIGTERM) 19:59:02.790238 run iperf3-srv_10.42.42.10(pid=21784): Terminating (SIGTERM) 19:59:02.830894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21785): Terminating (SIGTERM) 19:59:02.871895 run iperf3-srv_10.42.42.10(pid=21786): Terminating (SIGTERM) 19:59:02.912341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21787): Terminating (SIGTERM) 19:59:02.953026 run iperf3-srv_10.42.42.10(pid=21788): Terminating (SIGTERM) 19:59:02.993384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21791): Terminating (SIGTERM) 19:59:03.033807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21794): Terminating (SIGTERM) 19:59:03.074381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21797): Terminating (SIGTERM) 19:59:03.115262 --- ParallelTerminationStrategy: PID 21781 died... 19:59:03.134456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21781): Terminated: ok {rc=0} 19:59:03.179782 --- ParallelTerminationStrategy: PID 21782 died... 19:59:03.198789 run iperf3-srv_10.42.42.10(pid=21782): Terminated {rc=256} 19:59:03.242930 --- ParallelTerminationStrategy: PID 21783 died... 19:59:03.261843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21783): Terminated: ok {rc=0} 19:59:03.305829 --- ParallelTerminationStrategy: PID 21784 died... 19:59:03.324746 run iperf3-srv_10.42.42.10(pid=21784): Terminated {rc=256} 19:59:03.369104 --- ParallelTerminationStrategy: PID 21785 died... 19:59:03.387796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21785): Terminated: ok {rc=0} 19:59:03.431808 --- ParallelTerminationStrategy: PID 21786 died... 19:59:03.450598 run iperf3-srv_10.42.42.10(pid=21786): Terminated {rc=256} 19:59:03.494618 --- ParallelTerminationStrategy: PID 21787 died... 19:59:03.513359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21787): Terminated: ok {rc=0} 19:59:03.558203 --- ParallelTerminationStrategy: PID 21788 died... 19:59:03.577158 run iperf3-srv_10.42.42.10(pid=21788): Terminated {rc=256} 19:59:03.621473 --- ParallelTerminationStrategy: PID 21791 died... 19:59:03.640430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21791): Terminated: ok {rc=0} 19:59:03.684702 --- ParallelTerminationStrategy: PID 21794 died... 19:59:03.703650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21794): Terminated: ok {rc=0} 19:59:03.747978 --- ParallelTerminationStrategy: PID 21797 died... 19:59:03.766939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21797): Terminated: ok {rc=0} 19:59:03.853136 bus /gobi_4: Setting Powered False 19:59:04.953968 bus /gobi_4: Setting Powered False 19:59:06.068459 bus /gobi_1: Setting Powered False 19:59:07.167731 bus /gobi_1: Setting Powered False 19:59:08.288132 bus /gobi_0: Setting Powered False 19:59:09.389781 bus /gobi_0: Setting Powered False 19:59:10.508869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 19:59:11.612763 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:11.625066 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:59:11.678906 tst ping.py: using LAC 31152 19:59:11.803816 tst ping.py: using RAC 42 19:59:11.928791 tst ping.py: using CellId 31152 19:59:12.054531 tst ping.py: using BVCI 31153 19:59:12.169352 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:12.180638 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:12.191874 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:12.203294 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:12.214752 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:12.225829 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:12.237237 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:12.248919 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:59:12.363532 tst ping.py:19: start network... 19:59:12.561358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:13.019136 run create_hlr_db(pid=21800): Launched 19:59:13.142821 bus /gobi_6: Setting Powered False 19:59:14.202761 run create_hlr_db(pid=21800): Terminated: ok {rc=0} 19:59:14.638518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21802): Launched 19:59:14.957690 run osmo-hlr_10.42.42.2(pid=21803): Launched 19:59:15.080707 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:15.635375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21805): Launched 19:59:15.985719 run osmo-stp_10.42.42.5(pid=21806): Launched 19:59:16.173917 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:59:16.925718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21808): Launched 19:59:17.056873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:59:17.334213 run patchelf(pid=21809): Launched 19:59:17.513419 run osmo-stp_10.42.42.5(pid=21806): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21806)] 19:59:17.649254 run osmo-stp_10.42.42.5(pid=21806): stdout: | (launched: 2022-12-12_19:59:15.925207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:17.786119 run osmo-stp_10.42.42.5(pid=21806): stderr: | 20221212195916324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195916325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195916327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195916328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195916331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195916331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195916332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:17.923265 run osmo-stp_10.42.42.5(pid=21806): stdout: | (launched: 2022-12-12_19:59:15.925207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:18.053851 run osmo-stp_10.42.42.5(pid=21806): stderr: | 20221212195916324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195916325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195916327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195916328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195916331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195916331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195916332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:18.208836 run patchelf(pid=21809): Terminating (SIGINT) 19:59:18.386682 run patchelf(pid=21809): Terminated: ok {rc=0} 19:59:18.514594 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21806): Process ended prematurely: osmo-stp_10.42.42.5(pid=21806) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21806)] [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 19:59:18.524239 tst ping.py:22: Test FAILED (6.9 sec) 19:59:18.553507 run osmo-hlr_10.42.42.2(pid=21803): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21803)] 19:59:18.604775 run osmo-hlr_10.42.42.2(pid=21803): stdout: | (launched: 2022-12-12_19:59:14.899349) 19:59:18.657449 run osmo-hlr_10.42.42.2(pid=21803): stderr: | 20221212195915096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195915096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195915096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195915096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195915097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195915097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195915109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195915119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195915119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195915119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:18.710642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21802): Terminating (SIGTERM) 19:59:18.753146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21805): Terminating (SIGTERM) 19:59:18.795556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21808): Terminating (SIGTERM) 19:59:18.838109 --- ParallelTerminationStrategy: PID 21802 died... 19:59:18.858301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21802): Terminated: ok {rc=0} 19:59:18.905641 --- ParallelTerminationStrategy: PID 21805 died... 19:59:18.925347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21805): Terminated: ok {rc=0} 19:59:18.972379 --- ParallelTerminationStrategy: PID 21808 died... 19:59:18.992345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21808): Terminated: ok {rc=0} 19:59:19.081748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:59:20.171502 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.183625 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:59:20.236606 tst ping_idle_ping.py: using LAC 31153 19:59:20.360809 tst ping_idle_ping.py: using RAC 43 19:59:20.484864 tst ping_idle_ping.py: using CellId 31153 19:59:20.610015 tst ping_idle_ping.py: using BVCI 31154 19:59:20.727740 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.739225 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.750455 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.762132 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.773560 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.785082 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.796648 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:59:20.808356 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:59:20.924078 tst ping_idle_ping.py:24: start network... 19:59:21.123761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:21.586325 run create_hlr_db(pid=21810): Launched 19:59:21.712550 bus /gobi_6: Setting Powered False 19:59:22.776228 run create_hlr_db(pid=21810): Terminated: ok {rc=0} 19:59:23.220305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21812): Launched 19:59:23.539735 run osmo-hlr_10.42.42.2(pid=21813): Launched 19:59:23.663172 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:24.211495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21815): Launched 19:59:24.533515 run osmo-stp_10.42.42.5(pid=21816): Launched 19:59:24.658025 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:59:25.207689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21818): Launched 19:59:25.331278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:59:25.601831 run patchelf(pid=21819): Launched 19:59:25.780383 run osmo-stp_10.42.42.5(pid=21816): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21816)] 19:59:25.915445 run osmo-stp_10.42.42.5(pid=21816): stdout: | (launched: 2022-12-12_19:59:24.474496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:26.052150 run osmo-stp_10.42.42.5(pid=21816): stderr: | 20221212195924666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195924666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195924666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195924667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195924667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195924667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195924668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:26.189334 run osmo-stp_10.42.42.5(pid=21816): stdout: | (launched: 2022-12-12_19:59:24.474496) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:26.319762 run osmo-stp_10.42.42.5(pid=21816): stderr: | 20221212195924666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195924666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195924666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195924667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195924667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195924667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195924668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:26.474632 run patchelf(pid=21819): Terminating (SIGINT) 19:59:26.652246 run patchelf(pid=21819): Terminated: ok {rc=0} 19:59:26.780231 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21816): Process ended prematurely: osmo-stp_10.42.42.5(pid=21816) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21816)] [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 19:59:26.790044 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:59:26.819128 run osmo-hlr_10.42.42.2(pid=21813): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21813)] 19:59:26.870052 run osmo-hlr_10.42.42.2(pid=21813): stdout: | (launched: 2022-12-12_19:59:23.480383) 19:59:26.922534 run osmo-hlr_10.42.42.2(pid=21813): stderr: | 20221212195923677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195923677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195923677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195923677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195923677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195923677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195923689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195923697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195923697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195923697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:26.975223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21812): Terminating (SIGTERM) 19:59:27.017499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21815): Terminating (SIGTERM) 19:59:27.059877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21818): Terminating (SIGTERM) 19:59:27.102870 --- ParallelTerminationStrategy: PID 21812 died... 19:59:27.123066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21812): Terminated: ok {rc=0} 19:59:27.170183 --- ParallelTerminationStrategy: PID 21815 died... 19:59:27.190045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21815): Terminated: ok {rc=0} 19:59:27.237271 --- ParallelTerminationStrategy: PID 21818 died... 19:59:27.256832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21818): Terminated: ok {rc=0} 19:59:27.346395 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:59:28.655883 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:28.662679 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:59:28.698597 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:59:28.738480 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:59:28.828278 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:59:28.862572 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:59:28.902510 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:59:29.494786 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:59:29.546071 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:29.557070 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:59:29.627757 tst cs_paging_gprs_active.py: using LAC 31154 19:59:29.750620 tst cs_paging_gprs_active.py: using RAC 44 19:59:29.878079 tst cs_paging_gprs_active.py: using CellId 31154 19:59:30.003182 tst cs_paging_gprs_active.py: using BVCI 31155 19:59:30.121556 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.133267 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.144681 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.156664 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.168565 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.180585 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.192672 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.204490 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:30.216591 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:59:30.333672 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:59:30.449277 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:59:30.653005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:59:30.986288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21823): Launched 19:59:31.294757 run iperf3-srv_10.42.42.10(pid=21824): Launched 19:59:31.426677 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:59:31.636618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:59:31.948151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21825): Launched 19:59:32.229817 run iperf3-srv_10.42.42.10(pid=21826): Launched 19:59:32.342926 tst cs_paging_gprs_active.py:38: start network... 19:59:32.544325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:33.011114 run create_hlr_db(pid=21827): Launched 19:59:33.139967 bus /gobi_6: Setting Powered False 19:59:34.204756 run create_hlr_db(pid=21827): Terminated: ok {rc=0} 19:59:34.641756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Launched 19:59:34.944008 run osmo-hlr_10.42.42.2(pid=21835): Launched 19:59:35.058520 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:35.577442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Launched 19:59:35.879102 run osmo-stp_10.42.42.5(pid=21838): Launched 19:59:35.995737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:59:36.513942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21840): Launched 19:59:36.630996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:59:36.894159 run patchelf(pid=21841): Launched 19:59:37.063409 run osmo-stp_10.42.42.5(pid=21838): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] 19:59:37.191879 run osmo-stp_10.42.42.5(pid=21838): stdout: | (launched: 2022-12-12_19:59:35.822822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:37.321920 run osmo-stp_10.42.42.5(pid=21838): stderr: | 20221212195935992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195935993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195935993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195935993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195935994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195935994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195935994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:37.452149 run osmo-stp_10.42.42.5(pid=21838): stdout: | (launched: 2022-12-12_19:59:35.822822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:37.576316 run osmo-stp_10.42.42.5(pid=21838): stderr: | 20221212195935992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195935993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195935993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195935993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195935994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195935994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195935994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:37.723058 run patchelf(pid=21841): Terminating (SIGINT) 19:59:37.893185 run patchelf(pid=21841): Terminated: ok {rc=0} 19:59:38.015613 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21838): Process ended prematurely: osmo-stp_10.42.42.5(pid=21838) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:59:38.025103 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 19:59:38.052380 run osmo-hlr_10.42.42.2(pid=21835): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21835)] 19:59:38.100311 run osmo-hlr_10.42.42.2(pid=21835): stdout: | (launched: 2022-12-12_19:59:34.887984) 19:59:38.150099 run osmo-hlr_10.42.42.2(pid=21835): stderr: | 20221212195935063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195935063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195935063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195935063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195935063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195935063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195935111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195935120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195935120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195935120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:38.200325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21823): Terminating (SIGTERM) 19:59:38.240093 run iperf3-srv_10.42.42.10(pid=21824): Terminating (SIGTERM) 19:59:38.279810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21825): Terminating (SIGTERM) 19:59:38.319800 run iperf3-srv_10.42.42.10(pid=21826): Terminating (SIGTERM) 19:59:38.359502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Terminating (SIGTERM) 19:59:38.399137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Terminating (SIGTERM) 19:59:38.438640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21840): Terminating (SIGTERM) 19:59:38.478678 --- ParallelTerminationStrategy: PID 21823 died... 19:59:38.497753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21823): Terminated: ok {rc=0} 19:59:38.541618 --- ParallelTerminationStrategy: PID 21824 died... 19:59:38.560130 run iperf3-srv_10.42.42.10(pid=21824): Terminated {rc=256} 19:59:38.604484 --- ParallelTerminationStrategy: PID 21825 died... 19:59:38.623133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21825): Terminated: ok {rc=0} 19:59:38.667041 --- ParallelTerminationStrategy: PID 21826 died... 19:59:38.685744 run iperf3-srv_10.42.42.10(pid=21826): Terminated {rc=256} 19:59:38.729429 --- ParallelTerminationStrategy: PID 21834 died... 19:59:38.748137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Terminated: ok {rc=0} 19:59:38.791789 --- ParallelTerminationStrategy: PID 21837 died... 19:59:38.810448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Terminated: ok {rc=0} 19:59:38.854308 --- ParallelTerminationStrategy: PID 21840 died... 19:59:38.872933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21840): Terminated: ok {rc=0} 19:59:38.956132 bus /gobi_0: Setting Powered False 19:59:40.054853 bus /gobi_0: Setting Powered False 19:59:41.174537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:59:42.320931 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.332447 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:59:42.403064 tst iperf3.py: using LAC 31155 19:59:42.520765 tst iperf3.py: using RAC 45 19:59:42.638677 tst iperf3.py: using CellId 31155 19:59:42.760118 tst iperf3.py: using BVCI 31156 19:59:42.870610 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.881526 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.892277 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.903009 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.913749 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.924482 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.935536 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.946195 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:42.957006 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:59:43.074930 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:59:43.293709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:59:43.619472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21842): Launched 19:59:43.904094 run iperf3-srv_10.42.42.10(pid=21843): Launched 19:59:44.027139 tst iperf3.py:8: start network... 19:59:44.245641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:44.747331 run create_hlr_db(pid=21844): Launched 19:59:44.871535 bus /gobi_6: Setting Powered False 19:59:45.935766 run create_hlr_db(pid=21844): Terminated: ok {rc=0} 19:59:46.465931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21846): Launched 19:59:46.786193 run osmo-hlr_10.42.42.2(pid=21847): Launched 19:59:47.058863 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:47.699645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21849): Launched 19:59:48.026880 run osmo-stp_10.42.42.5(pid=21850): Launched 19:59:48.151765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:59:48.712037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21852): Launched 19:59:48.838624 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:59:49.113361 run patchelf(pid=21853): Launched 19:59:49.295321 run osmo-stp_10.42.42.5(pid=21850): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21850)] 19:59:49.432630 run osmo-stp_10.42.42.5(pid=21850): stdout: | (launched: 2022-12-12_19:59:47.967194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:49.571997 run osmo-stp_10.42.42.5(pid=21850): stderr: | 20221212195948156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195948156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195948157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195948157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195948157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195948157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195948158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:49.711741 run osmo-stp_10.42.42.5(pid=21850): stdout: | (launched: 2022-12-12_19:59:47.967194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:49.844353 run osmo-stp_10.42.42.5(pid=21850): stderr: | 20221212195948156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212195948156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212195948157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212195948157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212195948157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212195948157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212195948158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:50.002008 run patchelf(pid=21853): Terminating (SIGINT) 19:59:50.182982 run patchelf(pid=21853): Terminated: ok {rc=0} 19:59:50.313906 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21850): Process ended prematurely: osmo-stp_10.42.42.5(pid=21850) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21850)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 19:59:50.324012 tst iperf3.py:8: Test FAILED (8.0 sec) 19:59:50.353633 run osmo-hlr_10.42.42.2(pid=21847): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21847)] 19:59:50.404374 run osmo-hlr_10.42.42.2(pid=21847): stdout: | (launched: 2022-12-12_19:59:46.728108) 19:59:50.457049 run osmo-hlr_10.42.42.2(pid=21847): stderr: | 20221212195946958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195946958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195946958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195946958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195946958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195946958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195946971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195946984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195946985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195946985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:50.509948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21842): Terminating (SIGTERM) 19:59:50.552473 run iperf3-srv_10.42.42.10(pid=21843): Terminating (SIGTERM) 19:59:50.594994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21846): Terminating (SIGTERM) 19:59:50.637849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21849): Terminating (SIGTERM) 19:59:50.680512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21852): Terminating (SIGTERM) 19:59:50.723327 --- ParallelTerminationStrategy: PID 21842 died... 19:59:50.743703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21842): Terminated: ok {rc=0} 19:59:50.791225 --- ParallelTerminationStrategy: PID 21843 died... 19:59:50.811043 run iperf3-srv_10.42.42.10(pid=21843): Terminated {rc=256} 19:59:50.858142 --- ParallelTerminationStrategy: PID 21846 died... 19:59:50.877883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21846): Terminated: ok {rc=0} 19:59:50.924439 --- ParallelTerminationStrategy: PID 21849 died... 19:59:50.944161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21849): Terminated: ok {rc=0} 19:59:50.991741 --- ParallelTerminationStrategy: PID 21852 died... 19:59:51.011647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21852): Terminated: ok {rc=0} 19:59:51.101169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:59:52.252248 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.264402 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:59:52.336532 tst iperf3m4.py: using LAC 31156 19:59:52.463248 tst iperf3m4.py: using RAC 46 19:59:52.590396 tst iperf3m4.py: using CellId 31156 19:59:52.716005 tst iperf3m4.py: using BVCI 31157 19:59:52.833468 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.844821 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.856127 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.867788 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.879331 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.890922 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.902555 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.914036 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:59:52.925808 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:59:53.043722 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:59:53.164135 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:59:53.280466 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:59:53.396774 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:59:53.600062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:59:53.904798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21854): Launched 19:59:54.170494 run iperf3-srv_10.42.42.10(pid=21855): Launched 19:59:54.285888 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:59:54.487209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:59:54.790952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21856): Launched 19:59:55.056850 run iperf3-srv_10.42.42.10(pid=21857): Launched 19:59:55.170196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:59:55.371088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:59:55.675241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21858): Launched 19:59:55.941303 run iperf3-srv_10.42.42.10(pid=21859): Launched 19:59:56.054715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:59:56.256047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:59:56.559821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21860): Launched 19:59:56.846688 run iperf3-srv_10.42.42.10(pid=21861): Launched 19:59:56.970274 tst iperf3m4.py:8: start network... 19:59:57.188491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:57.691732 run create_hlr_db(pid=21862): Launched 19:59:57.816490 bus /gobi_6: Setting Powered False 19:59:58.880801 run create_hlr_db(pid=21862): Terminated: ok {rc=0} 19:59:59.313056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21864): Launched 19:59:59.614956 run osmo-hlr_10.42.42.2(pid=21865): Launched 19:59:59.730089 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:00.247412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21867): Launched 20:00:00.551051 run osmo-stp_10.42.42.5(pid=21868): Launched 20:00:00.667975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:00:01.232346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21870): Launched 20:00:01.404750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:00:01.715869 run patchelf(pid=21874): Launched 20:00:01.976515 run osmo-stp_10.42.42.5(pid=21868): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21868)] 20:00:02.156076 run osmo-stp_10.42.42.5(pid=21868): stdout: | (launched: 2022-12-12_20:00:00.494086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:02.290339 run osmo-stp_10.42.42.5(pid=21868): stderr: | 20221212200000663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200000664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200000664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200000664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200000665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200000665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200000665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:02.423825 run osmo-stp_10.42.42.5(pid=21868): stdout: | (launched: 2022-12-12_20:00:00.494086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:02.547191 run osmo-stp_10.42.42.5(pid=21868): stderr: | 20221212200000663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200000664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200000664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200000664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200000665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200000665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200000665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:02.693450 run patchelf(pid=21874): Terminating (SIGINT) 20:00:02.862429 run patchelf(pid=21874): Terminated: ok {rc=0} 20:00:02.983985 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21868): Process ended prematurely: osmo-stp_10.42.42.5(pid=21868) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21868)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:00:02.993668 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:00:03.021563 run osmo-hlr_10.42.42.2(pid=21865): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21865)] 20:00:03.069813 run osmo-hlr_10.42.42.2(pid=21865): stdout: | (launched: 2022-12-12_19:59:59.558819) 20:00:03.119854 run osmo-hlr_10.42.42.2(pid=21865): stderr: | 20221212195959734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212195959734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212195959734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212195959734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212195959734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212195959734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212195959746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212195959755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212195959756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212195959756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:03.170187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21854): Terminating (SIGTERM) 20:00:03.210387 run iperf3-srv_10.42.42.10(pid=21855): Terminating (SIGTERM) 20:00:03.250283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21856): Terminating (SIGTERM) 20:00:03.290253 run iperf3-srv_10.42.42.10(pid=21857): Terminating (SIGTERM) 20:00:03.330144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21858): Terminating (SIGTERM) 20:00:03.370054 run iperf3-srv_10.42.42.10(pid=21859): Terminating (SIGTERM) 20:00:03.409867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21860): Terminating (SIGTERM) 20:00:03.449556 run iperf3-srv_10.42.42.10(pid=21861): Terminating (SIGTERM) 20:00:03.489229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21864): Terminating (SIGTERM) 20:00:03.529250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21867): Terminating (SIGTERM) 20:00:03.569174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21870): Terminating (SIGTERM) 20:00:03.609423 --- ParallelTerminationStrategy: PID 21854 died... 20:00:03.628680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21854): Terminated: ok {rc=0} 20:00:03.673630 --- ParallelTerminationStrategy: PID 21855 died... 20:00:03.692452 run iperf3-srv_10.42.42.10(pid=21855): Terminated {rc=256} 20:00:03.737469 --- ParallelTerminationStrategy: PID 21856 died... 20:00:03.756297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21856): Terminated: ok {rc=0} 20:00:03.800895 --- ParallelTerminationStrategy: PID 21857 died... 20:00:03.820246 run iperf3-srv_10.42.42.10(pid=21857): Terminated {rc=256} 20:00:03.864394 --- ParallelTerminationStrategy: PID 21858 died... 20:00:03.883245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21858): Terminated: ok {rc=0} 20:00:03.927456 --- ParallelTerminationStrategy: PID 21859 died... 20:00:03.946236 run iperf3-srv_10.42.42.10(pid=21859): Terminated {rc=256} 20:00:03.990448 --- ParallelTerminationStrategy: PID 21860 died... 20:00:04.009118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21860): Terminated: ok {rc=0} 20:00:04.053464 --- ParallelTerminationStrategy: PID 21861 died... 20:00:04.072378 run iperf3-srv_10.42.42.10(pid=21861): Terminated {rc=256} 20:00:04.116676 --- ParallelTerminationStrategy: PID 21864 died... 20:00:04.135561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21864): Terminated: ok {rc=0} 20:00:04.179785 --- ParallelTerminationStrategy: PID 21867 died... 20:00:04.198652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21867): Terminated: ok {rc=0} 20:00:04.243438 --- ParallelTerminationStrategy: PID 21870 died... 20:00:04.262273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21870): Terminated: ok {rc=0} 20:00:04.348365 bus /gobi_4: Setting Powered False 20:00:05.449384 bus /gobi_4: Setting Powered False 20:00:06.564080 bus /gobi_1: Setting Powered False 20:00:07.662622 bus /gobi_1: Setting Powered False 20:00:08.781616 bus /gobi_0: Setting Powered False 20:00:09.883480 bus /gobi_0: Setting Powered False 20:00:11.001533 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:00:12.105866 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.117985 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:00:12.192231 tst ping.py: using LAC 31157 20:00:12.316151 tst ping.py: using RAC 47 20:00:12.438316 tst ping.py: using CellId 31157 20:00:12.565284 tst ping.py: using BVCI 31158 20:00:12.681890 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.693376 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.704537 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.716068 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.727409 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.739054 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.750601 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:12.762027 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:00:12.880171 tst ping.py:19: start network... 20:00:13.093047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:13.583408 run create_hlr_db(pid=21875): Launched 20:00:13.706258 bus /gobi_6: Setting Powered False 20:00:14.768846 run create_hlr_db(pid=21875): Terminated: ok {rc=0} 20:00:15.195226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Launched 20:00:15.492251 run osmo-hlr_10.42.42.2(pid=21878): Launched 20:00:15.606092 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:16.158148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Launched 20:00:16.479795 run osmo-stp_10.42.42.5(pid=21881): Launched 20:00:16.714407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:00:17.402954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Launched 20:00:17.516520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:00:17.767936 run patchelf(pid=21884): Launched 20:00:17.933706 run osmo-stp_10.42.42.5(pid=21881): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] 20:00:18.058955 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-12_20:00:16.422713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:18.185788 run osmo-stp_10.42.42.5(pid=21881): stderr: | 20221212200016753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200016753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200016754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200016754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200016754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200016755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200016755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:18.312839 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-12_20:00:16.422713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:18.433877 run osmo-stp_10.42.42.5(pid=21881): stderr: | 20221212200016753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200016753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200016754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200016754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200016754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200016755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200016755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:18.577542 run patchelf(pid=21884): Terminating (SIGINT) 20:00:18.742452 run patchelf(pid=21884): Terminated: ok {rc=0} 20:00:18.861905 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 20:00:18.870801 tst ping.py:22: Test FAILED (6.8 sec) 20:00:18.897928 run osmo-hlr_10.42.42.2(pid=21878): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21878)] 20:00:18.946263 run osmo-hlr_10.42.42.2(pid=21878): stdout: | (launched: 2022-12-12_20:00:15.436843) 20:00:18.996287 run osmo-hlr_10.42.42.2(pid=21878): stderr: | 20221212200015612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200015613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200015613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200015613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200015613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200015613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200015625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200015636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200015636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200015636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:19.046956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminating (SIGTERM) 20:00:19.087351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminating (SIGTERM) 20:00:19.127790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Terminating (SIGTERM) 20:00:19.168500 --- ParallelTerminationStrategy: PID 21877 died... 20:00:19.188130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminated: ok {rc=0} 20:00:19.233322 --- ParallelTerminationStrategy: PID 21880 died... 20:00:19.252286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminated: ok {rc=0} 20:00:19.297284 --- ParallelTerminationStrategy: PID 21883 died... 20:00:19.316149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Terminated: ok {rc=0} 20:00:19.403696 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:00:20.494940 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:20.507015 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:00:20.578776 tst ping_idle_ping.py: using LAC 31158 20:00:20.696855 tst ping_idle_ping.py: using RAC 48 20:00:20.813303 tst ping_idle_ping.py: using CellId 31158 20:00:20.930234 tst ping_idle_ping.py: using BVCI 31159 20:00:21.039352 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:21.050454 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:21.061265 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:21.072237 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:21.083243 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:21.094299 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:21.105419 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:00:21.116136 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:00:21.235423 tst ping_idle_ping.py:24: start network... 20:00:21.449920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:21.948177 run create_hlr_db(pid=21885): Launched 20:00:22.071723 bus /gobi_6: Setting Powered False 20:00:23.135279 run create_hlr_db(pid=21885): Terminated: ok {rc=0} 20:00:23.581707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21887): Launched 20:00:23.903137 run osmo-hlr_10.42.42.2(pid=21888): Launched 20:00:24.026065 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:24.577955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21890): Launched 20:00:24.899200 run osmo-stp_10.42.42.5(pid=21891): Launched 20:00:25.022136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:00:25.572140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21893): Launched 20:00:25.697454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:00:25.967769 run patchelf(pid=21894): Launched 20:00:26.146995 run osmo-stp_10.42.42.5(pid=21891): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21891)] 20:00:26.282389 run osmo-stp_10.42.42.5(pid=21891): stdout: | (launched: 2022-12-12_20:00:24.840025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:26.419144 run osmo-stp_10.42.42.5(pid=21891): stderr: | 20221212200025030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200025030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200025030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200025030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200025031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200025031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200025031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:26.555860 run osmo-stp_10.42.42.5(pid=21891): stdout: | (launched: 2022-12-12_20:00:24.840025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:26.687322 run osmo-stp_10.42.42.5(pid=21891): stderr: | 20221212200025030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200025030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200025030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200025030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200025031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200025031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200025031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:26.842815 run patchelf(pid=21894): Terminating (SIGINT) 20:00:27.020689 run patchelf(pid=21894): Terminated: ok {rc=0} 20:00:27.149056 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21891): Process ended prematurely: osmo-stp_10.42.42.5(pid=21891) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21891)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:00:27.158686 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:00:27.187786 run osmo-hlr_10.42.42.2(pid=21888): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21888)] 20:00:27.238545 run osmo-hlr_10.42.42.2(pid=21888): stdout: | (launched: 2022-12-12_20:00:23.844144) 20:00:27.291066 run osmo-hlr_10.42.42.2(pid=21888): stderr: | 20221212200024040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200024040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200024040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200024040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200024041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200024041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200024053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200024062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200024062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200024062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:27.343960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21887): Terminating (SIGTERM) 20:00:27.385900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21890): Terminating (SIGTERM) 20:00:27.428495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21893): Terminating (SIGTERM) 20:00:27.471562 --- ParallelTerminationStrategy: PID 21887 died... 20:00:27.492019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21887): Terminated: ok {rc=0} 20:00:27.539991 --- ParallelTerminationStrategy: PID 21890 died... 20:00:27.559988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21890): Terminated: ok {rc=0} 20:00:27.607534 --- ParallelTerminationStrategy: PID 21893 died... 20:00:27.627696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21893): Terminated: ok {rc=0} 20:00:27.718250 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:00:29.018801 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:29.024913 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:00:29.058208 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:00:29.096786 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:00:29.184148 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:00:29.217328 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:00:29.255670 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:00:29.848825 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:00:29.899121 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:29.910358 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:00:29.980058 tst cs_paging_gprs_active.py: using LAC 31159 20:00:30.099962 tst cs_paging_gprs_active.py: using RAC 49 20:00:30.221240 tst cs_paging_gprs_active.py: using CellId 31159 20:00:30.341251 tst cs_paging_gprs_active.py: using BVCI 31160 20:00:30.450932 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.462069 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.472680 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.483585 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.494589 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.505540 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.516484 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.527750 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:30.538938 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:00:30.654574 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:00:30.775545 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:00:30.981901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:00:31.300050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21899): Launched 20:00:31.588547 run iperf3-srv_10.42.42.10(pid=21900): Launched 20:00:31.722352 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:00:31.930380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:00:32.239797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21901): Launched 20:00:32.533979 run iperf3-srv_10.42.42.10(pid=21902): Launched 20:00:32.657549 tst cs_paging_gprs_active.py:38: start network... 20:00:32.875842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:33.378442 run create_hlr_db(pid=21903): Launched 20:00:33.504392 bus /gobi_6: Setting Powered False 20:00:34.569077 run create_hlr_db(pid=21903): Terminated: ok {rc=0} 20:00:35.021107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21905): Launched 20:00:35.347560 run osmo-hlr_10.42.42.2(pid=21906): Launched 20:00:35.472132 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:36.029813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21908): Launched 20:00:36.355388 run osmo-stp_10.42.42.5(pid=21909): Launched 20:00:36.482102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:00:37.042997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21911): Launched 20:00:37.169448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:00:37.443950 run patchelf(pid=21912): Launched 20:00:37.628589 run osmo-stp_10.42.42.5(pid=21909): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21909)] 20:00:37.766544 run osmo-stp_10.42.42.5(pid=21909): stdout: | (launched: 2022-12-12_20:00:36.295583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:37.906366 run osmo-stp_10.42.42.5(pid=21909): stderr: | 20221212200036485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200036485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200036486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200036486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200036487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200036487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200036487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:38.046081 run osmo-stp_10.42.42.5(pid=21909): stdout: | (launched: 2022-12-12_20:00:36.295583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:38.179417 run osmo-stp_10.42.42.5(pid=21909): stderr: | 20221212200036485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200036485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200036486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200036486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200036487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200036487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200036487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:38.337671 run patchelf(pid=21912): Terminating (SIGINT) 20:00:38.519428 run patchelf(pid=21912): Terminated: ok {rc=0} 20:00:38.651176 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21909): Process ended prematurely: osmo-stp_10.42.42.5(pid=21909) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21909)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:00:38.661403 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 20:00:38.691544 run osmo-hlr_10.42.42.2(pid=21906): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21906)] 20:00:38.742377 run osmo-hlr_10.42.42.2(pid=21906): stdout: | (launched: 2022-12-12_20:00:35.287726) 20:00:38.795000 run osmo-hlr_10.42.42.2(pid=21906): stderr: | 20221212200035484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200035484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200035484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200035484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200035484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200035484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200035497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200035505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200035505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200035505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:38.848244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21899): Terminating (SIGTERM) 20:00:38.890706 run iperf3-srv_10.42.42.10(pid=21900): Terminating (SIGTERM) 20:00:38.932772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21901): Terminating (SIGTERM) 20:00:38.974990 run iperf3-srv_10.42.42.10(pid=21902): Terminating (SIGTERM) 20:00:39.017058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21905): Terminating (SIGTERM) 20:00:39.059204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21908): Terminating (SIGTERM) 20:00:39.101702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21911): Terminating (SIGTERM) 20:00:39.143922 --- ParallelTerminationStrategy: PID 21899 died... 20:00:39.164018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21899): Terminated: ok {rc=0} 20:00:39.210905 --- ParallelTerminationStrategy: PID 21900 died... 20:00:39.230545 run iperf3-srv_10.42.42.10(pid=21900): Terminated {rc=256} 20:00:39.277794 --- ParallelTerminationStrategy: PID 21901 died... 20:00:39.297393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21901): Terminated: ok {rc=0} 20:00:39.344370 --- ParallelTerminationStrategy: PID 21902 died... 20:00:39.364102 run iperf3-srv_10.42.42.10(pid=21902): Terminated {rc=256} 20:00:39.410738 --- ParallelTerminationStrategy: PID 21905 died... 20:00:39.430335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21905): Terminated: ok {rc=0} 20:00:39.477177 --- ParallelTerminationStrategy: PID 21908 died... 20:00:39.496791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21908): Terminated: ok {rc=0} 20:00:39.543495 --- ParallelTerminationStrategy: PID 21911 died... 20:00:39.563209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21911): Terminated: ok {rc=0} 20:00:39.652387 bus /gobi_0: Setting Powered False 20:00:40.752169 bus /gobi_0: Setting Powered False 20:00:41.871359 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:00:43.017870 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.029515 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:00:43.100686 tst iperf3.py: using LAC 31160 20:00:43.221460 tst iperf3.py: using RAC 50 20:00:43.347889 tst iperf3.py: using CellId 31160 20:00:43.474757 tst iperf3.py: using BVCI 31161 20:00:43.591823 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.603362 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.614822 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.626384 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.638189 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.649698 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.661266 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.672660 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:43.684330 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:00:43.803295 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:00:44.021677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:00:44.347148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21913): Launched 20:00:44.631290 run iperf3-srv_10.42.42.10(pid=21914): Launched 20:00:44.754564 tst iperf3.py:8: start network... 20:00:44.973202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:45.475512 run create_hlr_db(pid=21915): Launched 20:00:45.599219 bus /gobi_6: Setting Powered False 20:00:46.658521 run create_hlr_db(pid=21915): Terminated: ok {rc=0} 20:00:47.094121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21917): Launched 20:00:47.412444 run osmo-hlr_10.42.42.2(pid=21918): Launched 20:00:47.530069 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:48.055612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21920): Launched 20:00:48.360531 run osmo-stp_10.42.42.5(pid=21921): Launched 20:00:48.480245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:00:49.001200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21923): Launched 20:00:49.117083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:00:49.373182 run patchelf(pid=21924): Launched 20:00:49.542210 run osmo-stp_10.42.42.5(pid=21921): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21921)] 20:00:49.670335 run osmo-stp_10.42.42.5(pid=21921): stdout: | (launched: 2022-12-12_20:00:48.304254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:49.800035 run osmo-stp_10.42.42.5(pid=21921): stderr: | 20221212200048475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200048475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200048476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200048476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200048477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200048477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200048477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:49.930114 run osmo-stp_10.42.42.5(pid=21921): stdout: | (launched: 2022-12-12_20:00:48.304254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:50.054480 run osmo-stp_10.42.42.5(pid=21921): stderr: | 20221212200048475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200048475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200048476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200048476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200048477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200048477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200048477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:50.201244 run patchelf(pid=21924): Terminating (SIGINT) 20:00:50.370846 run patchelf(pid=21924): Terminated: ok {rc=0} 20:00:50.492869 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21921): Process ended prematurely: osmo-stp_10.42.42.5(pid=21921) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21921)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 20:00:50.502437 tst iperf3.py:8: Test FAILED (7.5 sec) 20:00:50.530021 run osmo-hlr_10.42.42.2(pid=21918): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21918)] 20:00:50.577989 run osmo-hlr_10.42.42.2(pid=21918): stdout: | (launched: 2022-12-12_20:00:47.356244) 20:00:50.628068 run osmo-hlr_10.42.42.2(pid=21918): stderr: | 20221212200047530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200047531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200047531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200047531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200047531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200047531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200047543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200047551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200047551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200047551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:50.678260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21913): Terminating (SIGTERM) 20:00:50.718253 run iperf3-srv_10.42.42.10(pid=21914): Terminating (SIGTERM) 20:00:50.758039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21917): Terminating (SIGTERM) 20:00:50.797875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21920): Terminating (SIGTERM) 20:00:50.837624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21923): Terminating (SIGTERM) 20:00:50.877837 --- ParallelTerminationStrategy: PID 21913 died... 20:00:50.896796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21913): Terminated: ok {rc=0} 20:00:50.941526 --- ParallelTerminationStrategy: PID 21914 died... 20:00:50.960060 run iperf3-srv_10.42.42.10(pid=21914): Terminated {rc=256} 20:00:51.004090 --- ParallelTerminationStrategy: PID 21917 died... 20:00:51.022990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21917): Terminated: ok {rc=0} 20:00:51.066936 --- ParallelTerminationStrategy: PID 21920 died... 20:00:51.085746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21920): Terminated: ok {rc=0} 20:00:51.129739 --- ParallelTerminationStrategy: PID 21923 died... 20:00:51.148619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21923): Terminated: ok {rc=0} 20:00:51.234199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:00:52.382461 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:52.394262 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:00:52.465691 tst iperf3m4.py: using LAC 31161 20:00:52.595333 tst iperf3m4.py: using RAC 51 20:00:52.724487 tst iperf3m4.py: using CellId 31161 20:00:52.853717 tst iperf3m4.py: using BVCI 31162 20:00:52.971828 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:52.983558 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:52.995011 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:53.007309 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:53.019680 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:53.031633 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:53.043917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:53.055863 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:00:53.068072 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:00:53.188398 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:00:53.306972 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:00:53.422860 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:00:53.542360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:00:53.763886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:00:54.091547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Launched 20:00:54.379050 run iperf3-srv_10.42.42.10(pid=21926): Launched 20:00:54.503807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:00:54.723204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:00:55.050397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21927): Launched 20:00:55.335045 run iperf3-srv_10.42.42.10(pid=21928): Launched 20:00:55.459066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:00:55.678602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:00:56.006368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21929): Launched 20:00:56.293129 run iperf3-srv_10.42.42.10(pid=21930): Launched 20:00:56.416931 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:00:56.635286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:00:56.962647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21931): Launched 20:00:57.246976 run iperf3-srv_10.42.42.10(pid=21932): Launched 20:00:57.370813 tst iperf3m4.py:8: start network... 20:00:57.589639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:58.093714 run create_hlr_db(pid=21933): Launched 20:00:58.217607 bus /gobi_6: Setting Powered False 20:00:59.282025 run create_hlr_db(pid=21933): Terminated: ok {rc=0} 20:00:59.734639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21935): Launched 20:01:00.061626 run osmo-hlr_10.42.42.2(pid=21936): Launched 20:01:00.186344 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:00.745415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21938): Launched 20:01:01.118315 run osmo-stp_10.42.42.5(pid=21939): Launched 20:01:01.341974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:01:01.969772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21941): Launched 20:01:02.099937 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:01:02.368212 run patchelf(pid=21942): Launched 20:01:02.549587 run osmo-stp_10.42.42.5(pid=21939): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21939)] 20:01:02.687962 run osmo-stp_10.42.42.5(pid=21939): stdout: | (launched: 2022-12-12_20:01:01.045663) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:02.827602 run osmo-stp_10.42.42.5(pid=21939): stderr: | 20221212200101279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200101279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200101279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200101280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200101280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200101280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200101280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:02.967450 run osmo-stp_10.42.42.5(pid=21939): stdout: | (launched: 2022-12-12_20:01:01.045663) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:03.100920 run osmo-stp_10.42.42.5(pid=21939): stderr: | 20221212200101279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200101279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200101279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200101280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200101280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200101280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200101280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:03.259285 run patchelf(pid=21942): Terminating (SIGINT) 20:01:03.440917 run patchelf(pid=21942): Terminated: ok {rc=0} 20:01:03.572004 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21939): Process ended prematurely: osmo-stp_10.42.42.5(pid=21939) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21939)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:01:03.582336 tst iperf3m4.py:8: Test FAILED (11.2 sec) 20:01:03.612336 run osmo-hlr_10.42.42.2(pid=21936): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21936)] 20:01:03.663415 run osmo-hlr_10.42.42.2(pid=21936): stdout: | (launched: 2022-12-12_20:01:00.001426) 20:01:03.716226 run osmo-hlr_10.42.42.2(pid=21936): stderr: | 20221212200100199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200100199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200100199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200100199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200100199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200100199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200100212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200100220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200100220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200100220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:03.769532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Terminating (SIGTERM) 20:01:03.812014 run iperf3-srv_10.42.42.10(pid=21926): Terminating (SIGTERM) 20:01:03.854671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21927): Terminating (SIGTERM) 20:01:03.897213 run iperf3-srv_10.42.42.10(pid=21928): Terminating (SIGTERM) 20:01:03.939579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21929): Terminating (SIGTERM) 20:01:03.982200 run iperf3-srv_10.42.42.10(pid=21930): Terminating (SIGTERM) 20:01:04.024763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21931): Terminating (SIGTERM) 20:01:04.067394 run iperf3-srv_10.42.42.10(pid=21932): Terminating (SIGTERM) 20:01:04.109988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21935): Terminating (SIGTERM) 20:01:04.152671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21938): Terminating (SIGTERM) 20:01:04.195371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21941): Terminating (SIGTERM) 20:01:04.238459 --- ParallelTerminationStrategy: PID 21925 died... 20:01:04.258588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Terminated: ok {rc=0} 20:01:04.306224 --- ParallelTerminationStrategy: PID 21926 died... 20:01:04.326137 run iperf3-srv_10.42.42.10(pid=21926): Terminated {rc=256} 20:01:04.373251 --- ParallelTerminationStrategy: PID 21927 died... 20:01:04.393223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21927): Terminated: ok {rc=0} 20:01:04.440180 --- ParallelTerminationStrategy: PID 21928 died... 20:01:04.460153 run iperf3-srv_10.42.42.10(pid=21928): Terminated {rc=256} 20:01:04.507091 --- ParallelTerminationStrategy: PID 21929 died... 20:01:04.526976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21929): Terminated: ok {rc=0} 20:01:04.574125 --- ParallelTerminationStrategy: PID 21930 died... 20:01:04.593961 run iperf3-srv_10.42.42.10(pid=21930): Terminated {rc=256} 20:01:04.641843 --- ParallelTerminationStrategy: PID 21931 died... 20:01:04.661458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21931): Terminated: ok {rc=0} 20:01:04.708808 --- ParallelTerminationStrategy: PID 21932 died... 20:01:04.728939 run iperf3-srv_10.42.42.10(pid=21932): Terminated {rc=256} 20:01:04.776169 --- ParallelTerminationStrategy: PID 21935 died... 20:01:04.795865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21935): Terminated: ok {rc=0} 20:01:04.843439 --- ParallelTerminationStrategy: PID 21938 died... 20:01:04.863360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21938): Terminated: ok {rc=0} 20:01:04.911288 --- ParallelTerminationStrategy: PID 21941 died... 20:01:04.931186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21941): Terminated: ok {rc=0} 20:01:05.020896 bus /gobi_4: Setting Powered False 20:01:06.121601 bus /gobi_4: Setting Powered False 20:01:07.239706 bus /gobi_1: Setting Powered False 20:01:08.339943 bus /gobi_1: Setting Powered False 20:01:09.457608 bus /gobi_0: Setting Powered False 20:01:10.556406 bus /gobi_0: Setting Powered False 20:01:11.675320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:01:12.778792 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:12.791354 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:01:12.864510 tst ping.py: using LAC 31162 20:01:12.989783 tst ping.py: using RAC 52 20:01:13.114288 tst ping.py: using CellId 31162 20:01:13.238180 tst ping.py: using BVCI 31163 20:01:13.354188 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:13.365728 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:13.376929 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:13.388545 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:13.400064 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:13.411583 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:13.423205 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:13.434818 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:01:13.550197 tst ping.py:19: start network... 20:01:13.750789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:14.212266 run create_hlr_db(pid=21943): Launched 20:01:14.336033 bus /gobi_6: Setting Powered False 20:01:15.396734 run create_hlr_db(pid=21943): Terminated: ok {rc=0} 20:01:15.815279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21945): Launched 20:01:16.128056 run osmo-hlr_10.42.42.2(pid=21946): Launched 20:01:16.259977 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:17.002386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21948): Launched 20:01:17.369767 run osmo-stp_10.42.42.5(pid=21949): Launched 20:01:17.547320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:01:18.060819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21951): Launched 20:01:18.175651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:01:18.429690 run patchelf(pid=21952): Launched 20:01:18.596485 run osmo-stp_10.42.42.5(pid=21949): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21949)] 20:01:18.723212 run osmo-stp_10.42.42.5(pid=21949): stdout: | (launched: 2022-12-12_20:01:17.311102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:18.851210 run osmo-stp_10.42.42.5(pid=21949): stderr: | 20221212200117494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200117494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200117494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200117495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200117495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200117495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200117495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:18.989921 run osmo-stp_10.42.42.5(pid=21949): stdout: | (launched: 2022-12-12_20:01:17.311102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:19.111979 run osmo-stp_10.42.42.5(pid=21949): stderr: | 20221212200117494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200117494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200117494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200117495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200117495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200117495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200117495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:19.257500 run patchelf(pid=21952): Terminating (SIGINT) 20:01:19.424785 run patchelf(pid=21952): Terminated: ok {rc=0} 20:01:19.544667 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21949): Process ended prematurely: osmo-stp_10.42.42.5(pid=21949) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21949)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 20:01:19.553575 tst ping.py:22: Test FAILED (6.8 sec) 20:01:19.580856 run osmo-hlr_10.42.42.2(pid=21946): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21946)] 20:01:19.629174 run osmo-hlr_10.42.42.2(pid=21946): stdout: | (launched: 2022-12-12_20:01:16.071098) 20:01:19.679404 run osmo-hlr_10.42.42.2(pid=21946): stderr: | 20221212200116460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200116460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200116460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200116460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200116461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200116461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200116486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200116503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200116503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200116503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:19.730016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21945): Terminating (SIGTERM) 20:01:19.770531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21948): Terminating (SIGTERM) 20:01:19.811001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21951): Terminating (SIGTERM) 20:01:19.851978 --- ParallelTerminationStrategy: PID 21945 died... 20:01:19.871290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21945): Terminated: ok {rc=0} 20:01:19.916343 --- ParallelTerminationStrategy: PID 21948 died... 20:01:19.935247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21948): Terminated: ok {rc=0} 20:01:19.980123 --- ParallelTerminationStrategy: PID 21951 died... 20:01:19.999221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21951): Terminated: ok {rc=0} 20:01:20.085860 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:01:21.176526 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.188342 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:01:21.259571 tst ping_idle_ping.py: using LAC 31163 20:01:21.386442 tst ping_idle_ping.py: using RAC 53 20:01:21.511326 tst ping_idle_ping.py: using CellId 31163 20:01:21.638177 tst ping_idle_ping.py: using BVCI 31164 20:01:21.754947 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.766776 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.778318 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.790412 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.802330 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.814382 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.826491 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:01:21.838489 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:01:21.958973 tst ping_idle_ping.py:24: start network... 20:01:22.174500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:22.673616 run create_hlr_db(pid=21953): Launched 20:01:22.795944 bus /gobi_6: Setting Powered False 20:01:23.859225 run create_hlr_db(pid=21953): Terminated: ok {rc=0} 20:01:24.291350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21955): Launched 20:01:24.592090 run osmo-hlr_10.42.42.2(pid=21956): Launched 20:01:24.705610 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:25.218954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21958): Launched 20:01:25.517236 run osmo-stp_10.42.42.5(pid=21959): Launched 20:01:25.630219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:01:26.143577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21961): Launched 20:01:26.259418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:01:26.512035 run patchelf(pid=21962): Launched 20:01:26.678068 run osmo-stp_10.42.42.5(pid=21959): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21959)] 20:01:26.804063 run osmo-stp_10.42.42.5(pid=21959): stdout: | (launched: 2022-12-12_20:01:25.461703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:26.932157 run osmo-stp_10.42.42.5(pid=21959): stderr: | 20221212200125631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200125631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200125631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200125632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200125632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200125632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200125632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:27.059713 run osmo-stp_10.42.42.5(pid=21959): stdout: | (launched: 2022-12-12_20:01:25.461703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:27.181705 run osmo-stp_10.42.42.5(pid=21959): stderr: | 20221212200125631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200125631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200125631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200125632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200125632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200125632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200125632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:27.325875 run patchelf(pid=21962): Terminating (SIGINT) 20:01:27.492501 run patchelf(pid=21962): Terminated: ok {rc=0} 20:01:27.612002 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21959): Process ended prematurely: osmo-stp_10.42.42.5(pid=21959) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21959)] [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:01:27.620992 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:01:27.648124 run osmo-hlr_10.42.42.2(pid=21956): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21956)] 20:01:27.696104 run osmo-hlr_10.42.42.2(pid=21956): stdout: | (launched: 2022-12-12_20:01:24.535992) 20:01:27.745749 run osmo-hlr_10.42.42.2(pid=21956): stderr: | 20221212200124713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200124713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200124713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200124713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200124714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200124714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200124726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200124734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200124735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200124735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:27.795902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21955): Terminating (SIGTERM) 20:01:27.836063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21958): Terminating (SIGTERM) 20:01:27.876129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21961): Terminating (SIGTERM) 20:01:27.916598 --- ParallelTerminationStrategy: PID 21955 died... 20:01:27.935957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21955): Terminated: ok {rc=0} 20:01:27.980349 --- ParallelTerminationStrategy: PID 21958 died... 20:01:27.999365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21958): Terminated: ok {rc=0} 20:01:28.043521 --- ParallelTerminationStrategy: PID 21961 died... 20:01:28.062473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21961): Terminated: ok {rc=0} 20:01:28.146339 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:01:29.446319 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:29.452821 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:01:29.485815 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:01:29.520465 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:01:29.571998 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:01:29.604745 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:01:29.638866 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:01:30.198995 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:01:30.204001 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.215334 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:01:30.282604 tst switch_tch_pdch.py: using LAC 31164 20:01:30.408588 tst switch_tch_pdch.py: using RAC 54 20:01:30.532043 tst switch_tch_pdch.py: using CellId 31164 20:01:30.656771 tst switch_tch_pdch.py: using BVCI 31165 20:01:30.773288 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.785151 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.796606 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.808895 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.821382 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.833840 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.846870 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:01:30.859872 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:01:31.006186 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:01:31.133271 tst switch_tch_pdch.py:51: start network... 20:01:31.354003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:31.854040 run create_hlr_db(pid=21967): Launched 20:01:32.008783 bus /gobi_6: Setting Powered False 20:01:33.071954 run create_hlr_db(pid=21967): Terminated: ok {rc=0} 20:01:33.515687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21969): Launched 20:01:33.836026 run osmo-hlr_10.42.42.2(pid=21970): Launched 20:01:33.958293 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:34.504334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21972): Launched 20:01:34.827098 run osmo-stp_10.42.42.5(pid=21973): Launched 20:01:34.950523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:01:35.499690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21975): Launched 20:01:35.623014 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:01:35.892422 run patchelf(pid=21976): Launched 20:01:36.071287 run osmo-stp_10.42.42.5(pid=21973): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21973)] 20:01:36.205755 run osmo-stp_10.42.42.5(pid=21973): stdout: | (launched: 2022-12-12_20:01:34.768222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:36.342800 run osmo-stp_10.42.42.5(pid=21973): stderr: | 20221212200134956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200134956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200134957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200134957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200134958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200134958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200134958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:36.479562 run osmo-stp_10.42.42.5(pid=21973): stdout: | (launched: 2022-12-12_20:01:34.768222) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:36.609856 run osmo-stp_10.42.42.5(pid=21973): stderr: | 20221212200134956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200134956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200134957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200134957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200134958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200134958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200134958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:36.764796 run patchelf(pid=21976): Terminating (SIGINT) 20:01:36.942424 run patchelf(pid=21976): Terminated: ok {rc=0} 20:01:37.070447 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21973): Process ended prematurely: osmo-stp_10.42.42.5(pid=21973) [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21973)] [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:01:37.079971 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 20:01:37.108744 run osmo-hlr_10.42.42.2(pid=21970): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21970)] 20:01:37.159073 run osmo-hlr_10.42.42.2(pid=21970): stdout: | (launched: 2022-12-12_20:01:33.777368) 20:01:37.211191 run osmo-hlr_10.42.42.2(pid=21970): stderr: | 20221212200133971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200133971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200133971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200133971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200133971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200133971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200133983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200133992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200133992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200133992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:37.263725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21969): Terminating (SIGTERM) 20:01:37.305616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21972): Terminating (SIGTERM) 20:01:37.347770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21975): Terminating (SIGTERM) 20:01:37.390001 --- ParallelTerminationStrategy: PID 21969 died... 20:01:37.410058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21969): Terminated: ok {rc=0} 20:01:37.456926 --- ParallelTerminationStrategy: PID 21972 died... 20:01:37.476518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21972): Terminated: ok {rc=0} 20:01:37.523236 --- ParallelTerminationStrategy: PID 21975 died... 20:01:37.542803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21975): Terminated: ok {rc=0} 20:01:37.630401 bus /gobi_0: Setting Powered False 20:01:38.731215 bus /gobi_0: Setting Powered False 20:01:39.845924 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:01:41.104329 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:41.110588 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:01:41.145566 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:01:41.181384 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:01:41.236342 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:01:41.270397 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:01:41.305639 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:01:41.861263 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:01:41.866543 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:41.878011 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:01:41.949398 tst switch_tch_pdch.py: using LAC 31165 20:01:42.074150 tst switch_tch_pdch.py: using RAC 55 20:01:42.200755 tst switch_tch_pdch.py: using CellId 31165 20:01:42.324631 tst switch_tch_pdch.py: using BVCI 31166 20:01:42.439434 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:42.450976 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:42.462316 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:42.474059 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:42.485589 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:42.497221 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:42.508799 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:01:42.520373 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:01:42.635774 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:01:42.753982 tst switch_tch_pdch.py:51: start network... 20:01:42.952850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:43.387357 run create_hlr_db(pid=21981): Launched 20:01:43.508396 bus /gobi_6: Setting Powered False 20:01:44.568590 run create_hlr_db(pid=21981): Terminated: ok {rc=0} 20:01:44.977500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21983): Launched 20:01:45.297485 run osmo-hlr_10.42.42.2(pid=21984): Launched 20:01:45.418913 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:45.964669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21986): Launched 20:01:46.324576 run osmo-stp_10.42.42.5(pid=21987): Launched 20:01:46.511784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:01:47.153687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21989): Launched 20:01:47.287345 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:01:47.559066 run patchelf(pid=21990): Launched 20:01:47.738010 run osmo-stp_10.42.42.5(pid=21987): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21987)] 20:01:47.872571 run osmo-stp_10.42.42.5(pid=21987): stdout: | (launched: 2022-12-12_20:01:46.265802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:48.009110 run osmo-stp_10.42.42.5(pid=21987): stderr: | 20221212200146583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200146583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200146583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200146584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200146584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200146584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200146584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:48.145817 run osmo-stp_10.42.42.5(pid=21987): stdout: | (launched: 2022-12-12_20:01:46.265802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:48.276307 run osmo-stp_10.42.42.5(pid=21987): stderr: | 20221212200146583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200146583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200146583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200146584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200146584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200146584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200146584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:48.431082 run patchelf(pid=21990): Terminating (SIGINT) 20:01:48.609531 run patchelf(pid=21990): Terminated: ok {rc=0} 20:01:48.738225 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21987): Process ended prematurely: osmo-stp_10.42.42.5(pid=21987) [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21987)] [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:01:48.747743 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 20:01:48.776527 run osmo-hlr_10.42.42.2(pid=21984): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21984)] 20:01:48.826645 run osmo-hlr_10.42.42.2(pid=21984): stdout: | (launched: 2022-12-12_20:01:45.238215) 20:01:48.878987 run osmo-hlr_10.42.42.2(pid=21984): stderr: | 20221212200145435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200145435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200145435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200145435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200145435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200145435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200145447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200145455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200145455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200145455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:48.931717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21983): Terminating (SIGTERM) 20:01:48.973510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21986): Terminating (SIGTERM) 20:01:49.015312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21989): Terminating (SIGTERM) 20:01:49.057315 --- ParallelTerminationStrategy: PID 21983 died... 20:01:49.077260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21983): Terminated: ok {rc=0} 20:01:49.123942 --- ParallelTerminationStrategy: PID 21986 died... 20:01:49.143502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21986): Terminated: ok {rc=0} 20:01:49.190160 --- ParallelTerminationStrategy: PID 21989 died... 20:01:49.209818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21989): Terminated: ok {rc=0} 20:01:49.298554 bus /gobi_0: Setting Powered False 20:01:50.398196 bus /gobi_0: Setting Powered False 20:01:51.514411 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 20:01:52.766116 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:52.770412 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:01:52.801008 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 20:01:52.808360 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:01:52.863152 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:01:52.893897 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 20:01:52.900857 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:01:53.437583 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 20:01:53.442718 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 20:01:53.454160 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:01:53.498757 tst mo_mt_sms.py: using LAC 31166 20:01:53.627063 tst mo_mt_sms.py: using RAC 56 20:01:53.765241 tst mo_mt_sms.py: using CellId 31166 20:01:53.890297 tst mo_mt_sms.py: using BVCI 31167 20:01:54.005114 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:01:54.123310 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:01:54.237549 tst mo_mt_sms.py:9: start nitb and bts... 20:01:54.437325 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:01:55.043897 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21994): Launched 20:01:55.342169 run osmo-nitb_10.42.42.2(pid=21995): Launched 20:01:55.508886 run osmo-nitb_10.42.42.2(pid=21995): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21995)] 20:01:55.642045 run osmo-nitb_10.42.42.2(pid=21995): stdout: | (launched: 2022-12-12_20:01:55.286879) 20:01:55.776425 run osmo-nitb_10.42.42.2(pid=21995): stderr: | (launched: 2022-12-12_20:01:55.330803) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:01:55.910986 run osmo-nitb_10.42.42.2(pid=21995): stdout: | (launched: 2022-12-12_20:01:55.286879) 20:01:56.039795 run osmo-nitb_10.42.42.2(pid=21995): stderr: | (launched: 2022-12-12_20:01:55.330803) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21995): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21995) [trial-2381↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21995)] 20:01:56.456518 tst osmo-nitb_10.42.42.2(pid=21995): stdout: | (launched: 2022-12-12_20:01:55.286879) 20:01:56.576407 tst osmo-nitb_10.42.42.2(pid=21995): stderr: | (launched: 2022-12-12_20:01:55.330803) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:01:56.717139 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21995): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21995) [trial-2381↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21995)] [trial-2381↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 20:01:56.725354 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 20:01:56.731772 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21994): Terminating (SIGTERM) 20:01:56.940165 --- ParallelTerminationStrategy: PID 21994 died... 20:01:56.960760 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21994): Terminated: ok {rc=0} 20:01:57.046659 bus /sierra_3: Setting Powered False 20:01:58.148000 bus /sierra_3: Setting Powered False 20:01:59.265928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 20:02:00.465237 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:00.469741 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:02:00.500599 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:02:00.528223 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:02:00.583897 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:02:00.615479 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:02:00.643311 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:02:01.209427 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 20:02:01.216018 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:01.228292 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:02:01.277784 tst mo_mt_sms.py: using LAC 31167 20:02:01.397666 tst mo_mt_sms.py: using RAC 57 20:02:01.520098 tst mo_mt_sms.py: using CellId 31167 20:02:01.645873 tst mo_mt_sms.py: using BVCI 31168 20:02:01.763293 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:01.775038 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:01.787015 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:01.798871 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:01.810967 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:01.822673 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:02:01.963695 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:02:02.100529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:02.600402 run create_hlr_db(pid=21999): Launched 20:02:02.723937 bus /sierra_2: Setting Powered False 20:02:03.784454 run create_hlr_db(pid=21999): Terminated: ok {rc=0} 20:02:04.222475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22001): Launched 20:02:04.543120 run osmo-hlr_10.42.42.2(pid=22002): Launched 20:02:04.663792 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:05.210801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22004): Launched 20:02:05.531014 run osmo-stp_10.42.42.5(pid=22005): Launched 20:02:05.654085 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:06.236046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22007): Launched 20:02:06.557731 run osmo-msc_10.42.42.6(pid=22008): Launched 20:02:06.737965 run osmo-stp_10.42.42.5(pid=22005): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22005)] 20:02:06.871747 run osmo-stp_10.42.42.5(pid=22005): stdout: | (launched: 2022-12-12_20:02:05.472084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:07.006756 run osmo-stp_10.42.42.5(pid=22005): stderr: | 20221212200205662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200205662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200205662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200205663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200205663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200205663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200205663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:07.140515 run osmo-stp_10.42.42.5(pid=22005): stdout: | (launched: 2022-12-12_20:02:05.472084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:07.267539 run osmo-stp_10.42.42.5(pid=22005): stderr: | 20221212200205662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200205662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200205662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200205663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200205663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200205663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200205663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:07.419491 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22005): Process ended prematurely: osmo-stp_10.42.42.5(pid=22005) [trial-2381↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22005)] [trial-2381↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 20:02:07.428324 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 20:02:07.456675 run osmo-hlr_10.42.42.2(pid=22002): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22002)] 20:02:07.507614 run osmo-hlr_10.42.42.2(pid=22002): stdout: | (launched: 2022-12-12_20:02:04.484407) 20:02:07.560290 run osmo-hlr_10.42.42.2(pid=22002): stderr: | 20221212200204682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200204682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200204682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200204682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200204682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200204682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200204695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200204705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200204705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200204705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:07.633540 run osmo-msc_10.42.42.6(pid=22008): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22008)] 20:02:07.684621 run osmo-msc_10.42.42.6(pid=22008): stdout: | (launched: 2022-12-12_20:02:06.498581) 20:02:07.737328 run osmo-msc_10.42.42.6(pid=22008): stderr: | 20221212200206822 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200206822 DLGLOBAL DEBUG validating counter group 0x7fe0df396c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200206822 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200206822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200206823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200206823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200206825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200206825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200206825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200206825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:07.790313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22001): Terminating (SIGTERM) 20:02:07.832648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22004): Terminating (SIGTERM) 20:02:07.875184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22007): Terminating (SIGTERM) 20:02:07.917794 --- ParallelTerminationStrategy: PID 22001 died... 20:02:07.938009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22001): Terminated: ok {rc=0} 20:02:07.985224 --- ParallelTerminationStrategy: PID 22004 died... 20:02:08.004941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22004): Terminated: ok {rc=0} 20:02:08.052074 --- ParallelTerminationStrategy: PID 22007 died... 20:02:08.072019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22007): Terminated: ok {rc=0} 20:02:08.162287 bus /sierra_3: Setting Powered False 20:02:09.262314 bus /sierra_3: Setting Powered False 20:02:10.381164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 20:02:11.612619 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:11.616660 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:02:11.647499 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 20:02:11.654566 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 20:02:11.690878 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:02:11.720651 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 20:02:11.727559 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 20:02:12.247910 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 20:02:12.254309 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 20:02:12.266395 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:02:12.313362 tst assert_extension.py: using LAC 31168 20:02:12.439286 tst assert_extension.py: using RAC 58 20:02:12.556452 tst assert_extension.py: using CellId 31168 20:02:12.683120 tst assert_extension.py: using BVCI 31169 20:02:12.798769 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 20:02:12.918405 tst assert_extension.py:10: start nitb and bts... 20:02:13.133070 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:02:13.785387 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22013): Launched 20:02:14.105218 run osmo-nitb_10.42.42.2(pid=22014): Launched 20:02:14.284252 run osmo-nitb_10.42.42.2(pid=22014): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22014)] 20:02:14.427932 run osmo-nitb_10.42.42.2(pid=22014): stdout: | (launched: 2022-12-12_20:02:14.046139) 20:02:14.573229 run osmo-nitb_10.42.42.2(pid=22014): stderr: | (launched: 2022-12-12_20:02:14.093460) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:02:14.719104 run osmo-nitb_10.42.42.2(pid=22014): stdout: | (launched: 2022-12-12_20:02:14.046139) 20:02:14.859132 run osmo-nitb_10.42.42.2(pid=22014): stderr: | (launched: 2022-12-12_20:02:14.093460) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22014) [trial-2381↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22014)] 20:02:15.227826 tst osmo-nitb_10.42.42.2(pid=22014): stdout: | (launched: 2022-12-12_20:02:14.046139) 20:02:15.357065 tst osmo-nitb_10.42.42.2(pid=22014): stderr: | (launched: 2022-12-12_20:02:14.093460) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:02:15.509408 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22014) [trial-2381↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22014)] [trial-2381↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 20:02:15.518676 tst assert_extension.py:12: Test FAILED (3.3 sec) 20:02:15.526151 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22013): Terminating (SIGTERM) 20:02:15.737493 --- ParallelTerminationStrategy: PID 22013 died... 20:02:15.760005 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22013): Terminated: ok {rc=0} 20:02:15.862484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 20:02:17.059500 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:17.064125 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:02:17.094806 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:02:17.122972 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 20:02:17.161053 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:02:17.194745 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:02:17.221974 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 20:02:17.743591 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 20:02:17.748775 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:17.759795 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:02:17.804325 tst assert_extension.py: using LAC 31169 20:02:17.922286 tst assert_extension.py: using RAC 59 20:02:18.038309 tst assert_extension.py: using CellId 31169 20:02:18.158692 tst assert_extension.py: using BVCI 31170 20:02:18.266223 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:18.277084 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:18.287730 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:18.298520 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:18.309254 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:02:18.319906 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 20:02:18.438256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:18.933620 run create_hlr_db(pid=22018): Launched 20:02:19.056635 bus /sierra_2: Setting Powered False 20:02:20.120363 run create_hlr_db(pid=22018): Terminated: ok {rc=0} 20:02:20.543019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22020): Launched 20:02:20.841741 run osmo-hlr_10.42.42.2(pid=22021): Launched 20:02:20.954741 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:21.468575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22023): Launched 20:02:21.766684 run osmo-stp_10.42.42.5(pid=22024): Launched 20:02:21.880678 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:22.417092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22026): Launched 20:02:22.714266 run osmo-msc_10.42.42.6(pid=22027): Launched 20:02:22.883382 run osmo-stp_10.42.42.5(pid=22024): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22024)] 20:02:23.009264 run osmo-stp_10.42.42.5(pid=22024): stdout: | (launched: 2022-12-12_20:02:21.711101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:23.134937 run osmo-stp_10.42.42.5(pid=22024): stderr: | 20221212200221878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200221878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200221878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200221879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200221879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200221879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200221879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:23.258071 run osmo-stp_10.42.42.5(pid=22024): stdout: | (launched: 2022-12-12_20:02:21.711101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:23.375970 run osmo-stp_10.42.42.5(pid=22024): stderr: | 20221212200221878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200221878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200221878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200221879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200221879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200221879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200221879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:23.516820 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22024): Process ended prematurely: osmo-stp_10.42.42.5(pid=22024) [trial-2381↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22024)] [trial-2381↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 20:02:23.525474 tst assert_extension.py:17: Test FAILED (5.8 sec) 20:02:23.551846 run osmo-hlr_10.42.42.2(pid=22021): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22021)] 20:02:23.599651 run osmo-hlr_10.42.42.2(pid=22021): stdout: | (launched: 2022-12-12_20:02:20.786330) 20:02:23.649589 run osmo-hlr_10.42.42.2(pid=22021): stderr: | 20221212200220960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200220960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200220960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200220960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200220960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200220960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200220973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200220983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200220983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200220983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:23.719335 run osmo-msc_10.42.42.6(pid=22027): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22027)] 20:02:23.767244 run osmo-msc_10.42.42.6(pid=22027): stdout: | (launched: 2022-12-12_20:02:22.658464) 20:02:23.817587 run osmo-msc_10.42.42.6(pid=22027): stderr: | 20221212200222928 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200222928 DLGLOBAL DEBUG validating counter group 0x7fef9a2d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200222928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200222928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200222928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200222929 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200222930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200222931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200222931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200222931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:23.867966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22020): Terminating (SIGTERM) 20:02:23.907717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22023): Terminating (SIGTERM) 20:02:23.947649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22026): Terminating (SIGTERM) 20:02:23.987878 --- ParallelTerminationStrategy: PID 22020 died... 20:02:24.007153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22020): Terminated: ok {rc=0} 20:02:24.051986 --- ParallelTerminationStrategy: PID 22023 died... 20:02:24.070837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22023): Terminated: ok {rc=0} 20:02:24.114882 --- ParallelTerminationStrategy: PID 22026 died... 20:02:24.133645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22026): Terminated: ok {rc=0} 20:02:24.217575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:02:25.428584 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:25.435641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:02:25.465641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:02:25.492301 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:02:25.547101 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:02:25.578631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:02:25.606779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:02:26.153613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:02:26.204014 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:26.215385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:02:26.281925 tst mo_mt_call.py: using LAC 31170 20:02:26.401293 tst mo_mt_call.py: using RAC 60 20:02:26.520052 tst mo_mt_call.py: using CellId 31170 20:02:26.638502 tst mo_mt_call.py: using BVCI 31171 20:02:26.758739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:26.770787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:26.782693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:26.794962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:26.807269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:26.819666 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:02:26.938835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:02:27.055079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:27.523626 run create_hlr_db(pid=22032): Launched 20:02:27.647730 bus /sierra_2: Setting Powered False 20:02:28.707202 run create_hlr_db(pid=22032): Terminated: ok {rc=0} 20:02:29.130070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Launched 20:02:29.433724 run osmo-hlr_10.42.42.2(pid=22035): Launched 20:02:29.548794 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:30.071987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Launched 20:02:30.374332 run osmo-stp_10.42.42.5(pid=22038): Launched 20:02:30.489461 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:31.053759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22040): Launched 20:02:31.401770 run osmo-msc_10.42.42.6(pid=22041): Launched 20:02:31.731606 run osmo-stp_10.42.42.5(pid=22038): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] 20:02:31.971999 run osmo-stp_10.42.42.5(pid=22038): stdout: | (launched: 2022-12-12_20:02:30.318094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:32.239113 run osmo-stp_10.42.42.5(pid=22038): stderr: | 20221212200230487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200230487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200230488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200230488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200230488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200230489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200230489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:32.369452 run osmo-stp_10.42.42.5(pid=22038): stdout: | (launched: 2022-12-12_20:02:30.318094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:32.488607 run osmo-stp_10.42.42.5(pid=22038): stderr: | 20221212200230487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200230487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200230488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200230488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200230488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200230489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200230489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:32.630782 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22038): Process ended prematurely: osmo-stp_10.42.42.5(pid=22038) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:02:32.639633 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:02:32.666064 run osmo-hlr_10.42.42.2(pid=22035): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22035)] 20:02:32.713658 run osmo-hlr_10.42.42.2(pid=22035): stdout: | (launched: 2022-12-12_20:02:29.377115) 20:02:32.763023 run osmo-hlr_10.42.42.2(pid=22035): stderr: | 20221212200229553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200229553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200229553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200229553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200229553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200229553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200229565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200229574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200229575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200229575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:32.831831 run osmo-msc_10.42.42.6(pid=22041): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22041)] 20:02:32.880230 run osmo-msc_10.42.42.6(pid=22041): stdout: | (launched: 2022-12-12_20:02:31.335220) 20:02:32.929437 run osmo-msc_10.42.42.6(pid=22041): stderr: | 20221212200231836 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200231836 DLGLOBAL DEBUG validating counter group 0x7f40a5ccac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200231836 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200231836 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200231836 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200231837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200231838 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200231839 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200231839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200231839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:32.978641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Terminating (SIGTERM) 20:02:33.018111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Terminating (SIGTERM) 20:02:33.057555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22040): Terminating (SIGTERM) 20:02:33.097403 --- ParallelTerminationStrategy: PID 22034 died... 20:02:33.116300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Terminated: ok {rc=0} 20:02:33.160543 --- ParallelTerminationStrategy: PID 22037 died... 20:02:33.179149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Terminated: ok {rc=0} 20:02:33.222947 --- ParallelTerminationStrategy: PID 22040 died... 20:02:33.242105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22040): Terminated: ok {rc=0} 20:02:33.328173 bus /sierra_3: Setting Powered False 20:02:34.427186 bus /sierra_3: Setting Powered False 20:02:35.543510 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:02:36.690287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:36.702417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:02:36.773140 tst mo_mt_call_osmux.py: using LAC 31171 20:02:36.890197 tst mo_mt_call_osmux.py: using RAC 61 20:02:37.006672 tst mo_mt_call_osmux.py: using CellId 31171 20:02:37.124421 tst mo_mt_call_osmux.py: using BVCI 31172 20:02:37.242285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:37.254363 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:37.266209 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:37.278426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:37.291010 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:02:37.303210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:02:37.420256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:02:37.540761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:38.041754 run create_hlr_db(pid=22043): Launched 20:02:38.165087 bus /sierra_2: Setting Powered False 20:02:39.229743 run create_hlr_db(pid=22043): Terminated: ok {rc=0} 20:02:39.660213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22045): Launched 20:02:39.961415 run osmo-hlr_10.42.42.2(pid=22046): Launched 20:02:40.076033 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:40.590282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22048): Launched 20:02:40.890419 run osmo-stp_10.42.42.5(pid=22049): Launched 20:02:41.004085 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:41.551245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22051): Launched 20:02:41.851815 run osmo-msc_10.42.42.6(pid=22052): Launched 20:02:42.020115 run osmo-stp_10.42.42.5(pid=22049): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22049)] 20:02:42.146912 run osmo-stp_10.42.42.5(pid=22049): stdout: | (launched: 2022-12-12_20:02:40.833900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:42.273427 run osmo-stp_10.42.42.5(pid=22049): stderr: | 20221212200241003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200241003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200241004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200241004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200241005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200241005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200241005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:42.398080 run osmo-stp_10.42.42.5(pid=22049): stdout: | (launched: 2022-12-12_20:02:40.833900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:42.516839 run osmo-stp_10.42.42.5(pid=22049): stderr: | 20221212200241003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200241003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200241004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200241004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200241005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200241005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200241005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:42.666152 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22049): Process ended prematurely: osmo-stp_10.42.42.5(pid=22049) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22049)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:02:42.674721 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:02:42.701185 run osmo-hlr_10.42.42.2(pid=22046): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22046)] 20:02:42.748672 run osmo-hlr_10.42.42.2(pid=22046): stdout: | (launched: 2022-12-12_20:02:39.904854) 20:02:42.797769 run osmo-hlr_10.42.42.2(pid=22046): stderr: | 20221212200240079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200240079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200240079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200240079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200240079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200240079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200240092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200240100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200240100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200240100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:42.866732 run osmo-msc_10.42.42.6(pid=22052): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22052)] 20:02:42.914102 run osmo-msc_10.42.42.6(pid=22052): stdout: | (launched: 2022-12-12_20:02:41.795394) 20:02:42.963857 run osmo-msc_10.42.42.6(pid=22052): stderr: | 20221212200242065 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200242065 DLGLOBAL DEBUG validating counter group 0x7f930995cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200242065 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200242065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200242065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200242065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200242067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200242067 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200242068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200242068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:43.013517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22045): Terminating (SIGTERM) 20:02:43.052887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22048): Terminating (SIGTERM) 20:02:43.092173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22051): Terminating (SIGTERM) 20:02:43.131893 --- ParallelTerminationStrategy: PID 22045 died... 20:02:43.150937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22045): Terminated: ok {rc=0} 20:02:43.194738 --- ParallelTerminationStrategy: PID 22048 died... 20:02:43.213302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22048): Terminated: ok {rc=0} 20:02:43.256797 --- ParallelTerminationStrategy: PID 22051 died... 20:02:43.275394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22051): Terminated: ok {rc=0} 20:02:43.360270 bus /sierra_3: Setting Powered False 20:02:44.459280 bus /sierra_3: Setting Powered False 20:02:45.575055 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:02:46.822827 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:46.830252 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:02:46.863382 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:02:46.892888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:02:46.947501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:02:46.980472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:02:47.010864 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:02:47.557863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:02:47.612019 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:47.624013 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:02:47.692344 tst mo_mt_call.py: using LAC 31172 20:02:47.820931 tst mo_mt_call.py: using RAC 62 20:02:47.940578 tst mo_mt_call.py: using CellId 31172 20:02:48.058199 tst mo_mt_call.py: using BVCI 31173 20:02:48.167825 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:48.179294 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:48.190902 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:48.202463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:48.214020 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:48.225442 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:02:48.345365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:02:48.464443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:48.962401 run create_hlr_db(pid=22057): Launched 20:02:49.086264 bus /sierra_2: Setting Powered False 20:02:50.150309 run create_hlr_db(pid=22057): Terminated: ok {rc=0} 20:02:50.579509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22059): Launched 20:02:50.902354 run osmo-hlr_10.42.42.2(pid=22060): Launched 20:02:51.025017 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:51.578014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22062): Launched 20:02:51.901783 run osmo-stp_10.42.42.5(pid=22063): Launched 20:02:52.024250 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:52.606889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Launched 20:02:52.934028 run osmo-msc_10.42.42.6(pid=22066): Launched 20:02:53.112811 run osmo-stp_10.42.42.5(pid=22063): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] 20:02:53.248833 run osmo-stp_10.42.42.5(pid=22063): stdout: | (launched: 2022-12-12_20:02:51.842357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:53.385489 run osmo-stp_10.42.42.5(pid=22063): stderr: | 20221212200252030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200252030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200252031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200252031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200252032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200252032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200252032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:53.519884 run osmo-stp_10.42.42.5(pid=22063): stdout: | (launched: 2022-12-12_20:02:51.842357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:53.648229 run osmo-stp_10.42.42.5(pid=22063): stderr: | 20221212200252030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200252030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200252031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200252031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200252032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200252032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200252032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:53.802738 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22063): Process ended prematurely: osmo-stp_10.42.42.5(pid=22063) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:02:53.812018 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:02:53.840582 run osmo-hlr_10.42.42.2(pid=22060): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22060)] 20:02:53.891107 run osmo-hlr_10.42.42.2(pid=22060): stdout: | (launched: 2022-12-12_20:02:50.843424) 20:02:53.943452 run osmo-hlr_10.42.42.2(pid=22060): stderr: | 20221212200251037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200251037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200251037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200251037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200251037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200251037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200251050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200251058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200251058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200251058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:54.016689 run osmo-msc_10.42.42.6(pid=22066): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22066)] 20:02:54.067368 run osmo-msc_10.42.42.6(pid=22066): stdout: | (launched: 2022-12-12_20:02:52.875842) 20:02:54.119535 run osmo-msc_10.42.42.6(pid=22066): stderr: | 20221212200253192 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200253192 DLGLOBAL DEBUG validating counter group 0x7f968da19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200253192 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200253192 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200253193 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200253193 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200253195 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200253195 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200253195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200253195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:54.172129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22059): Terminating (SIGTERM) 20:02:54.213977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22062): Terminating (SIGTERM) 20:02:54.255913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Terminating (SIGTERM) 20:02:54.298080 --- ParallelTerminationStrategy: PID 22059 died... 20:02:54.318170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22059): Terminated: ok {rc=0} 20:02:54.365467 --- ParallelTerminationStrategy: PID 22062 died... 20:02:54.385098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22062): Terminated: ok {rc=0} 20:02:54.431974 --- ParallelTerminationStrategy: PID 22065 died... 20:02:54.451587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Terminated: ok {rc=0} 20:02:54.540703 bus /sierra_3: Setting Powered False 20:02:55.640576 bus /sierra_3: Setting Powered False 20:02:56.757669 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:02:57.906806 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:57.919175 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:02:57.986813 tst mo_mt_call_osmux.py: using LAC 31173 20:02:58.113249 tst mo_mt_call_osmux.py: using RAC 63 20:02:58.238645 tst mo_mt_call_osmux.py: using CellId 31173 20:02:58.368779 tst mo_mt_call_osmux.py: using BVCI 31174 20:02:58.487763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:58.499523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:58.511113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:58.523047 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:58.534943 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:02:58.546848 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:02:58.663672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:02:58.783336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:59.283630 run create_hlr_db(pid=22068): Launched 20:02:59.406859 bus /sierra_2: Setting Powered False 20:03:00.471081 run create_hlr_db(pid=22068): Terminated: ok {rc=0} 20:03:00.950559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22070): Launched 20:03:01.288143 run osmo-hlr_10.42.42.2(pid=22072): Launched 20:03:01.459723 run osmo-stp_10.42.42.5: Starting osmo-stp 20:03:02.221783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22074): Launched 20:03:02.536516 run osmo-stp_10.42.42.5(pid=22075): Launched 20:03:02.652348 run osmo-msc_10.42.42.6: Starting osmo-msc 20:03:03.197870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22077): Launched 20:03:03.497809 run osmo-msc_10.42.42.6(pid=22078): Launched 20:03:03.666412 run osmo-stp_10.42.42.5(pid=22075): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22075)] 20:03:03.792846 run osmo-stp_10.42.42.5(pid=22075): stdout: | (launched: 2022-12-12_20:03:02.480721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:03.919345 run osmo-stp_10.42.42.5(pid=22075): stderr: | 20221212200302649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200302649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200302649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200302650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200302650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200302650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200302650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:04.044660 run osmo-stp_10.42.42.5(pid=22075): stdout: | (launched: 2022-12-12_20:03:02.480721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:04.163757 run osmo-stp_10.42.42.5(pid=22075): stderr: | 20221212200302649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200302649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200302649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200302650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200302650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200302650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200302650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:04.306743 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22075): Process ended prematurely: osmo-stp_10.42.42.5(pid=22075) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22075)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:03:04.315798 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:03:04.342745 run osmo-hlr_10.42.42.2(pid=22072): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22072)] 20:03:04.390530 run osmo-hlr_10.42.42.2(pid=22072): stdout: | (launched: 2022-12-12_20:03:01.228649) 20:03:04.440177 run osmo-hlr_10.42.42.2(pid=22072): stderr: | 20221212200301597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200301597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200301597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200301597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200301597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200301597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200301616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200301634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200301634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200301634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:03:04.509431 run osmo-msc_10.42.42.6(pid=22078): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22078)] 20:03:04.556767 run osmo-msc_10.42.42.6(pid=22078): stdout: | (launched: 2022-12-12_20:03:03.442198) 20:03:04.605844 run osmo-msc_10.42.42.6(pid=22078): stderr: | 20221212200303711 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200303712 DLGLOBAL DEBUG validating counter group 0x7f9c630aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200303712 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200303712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200303712 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200303712 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200303714 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200303714 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200303714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200303715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:03:04.655314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22070): Terminating (SIGTERM) 20:03:04.694727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22074): Terminating (SIGTERM) 20:03:04.734245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22077): Terminating (SIGTERM) 20:03:04.773977 --- ParallelTerminationStrategy: PID 22070 died... 20:03:04.792879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22070): Terminated: ok {rc=0} 20:03:04.837128 --- ParallelTerminationStrategy: PID 22074 died... 20:03:04.855652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22074): Terminated: ok {rc=0} 20:03:04.900404 --- ParallelTerminationStrategy: PID 22077 died... 20:03:04.919341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22077): Terminated: ok {rc=0} 20:03:05.004538 bus /sierra_3: Setting Powered False 20:03:06.105349 bus /sierra_3: Setting Powered False 20:03:07.220675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:03:08.466935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:03:08.473381 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:03:08.502661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:03:08.529451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:03:08.582659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:03:08.611668 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:03:08.638371 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:03:09.188649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:03:09.236817 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:09.248230 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:03:09.313437 tst mo_mt_call.py: using LAC 31174 20:03:09.435955 tst mo_mt_call.py: using RAC 64 20:03:09.553425 tst mo_mt_call.py: using CellId 31174 20:03:09.668361 tst mo_mt_call.py: using BVCI 31175 20:03:09.775693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:09.786946 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:09.797964 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:09.809012 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:09.820050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:09.831458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:03:09.950487 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:03:10.065388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:03:10.531980 run create_hlr_db(pid=22083): Launched 20:03:10.655000 bus /sierra_2: Setting Powered False 20:03:11.715298 run create_hlr_db(pid=22083): Terminated: ok {rc=0} 20:03:12.156049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22085): Launched 20:03:12.481464 run osmo-hlr_10.42.42.2(pid=22086): Launched 20:03:12.605422 run osmo-stp_10.42.42.5: Starting osmo-stp 20:03:13.160875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22088): Launched 20:03:13.488084 run osmo-stp_10.42.42.5(pid=22089): Launched 20:03:13.611384 run osmo-msc_10.42.42.6: Starting osmo-msc 20:03:14.199200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22091): Launched 20:03:14.523139 run osmo-msc_10.42.42.6(pid=22092): Launched 20:03:14.704350 run osmo-stp_10.42.42.5(pid=22089): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22089)] 20:03:14.841327 run osmo-stp_10.42.42.5(pid=22089): stdout: | (launched: 2022-12-12_20:03:13.429055) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:14.978674 run osmo-stp_10.42.42.5(pid=22089): stderr: | 20221212200313615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200313615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200313615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200313616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200313616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200313616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200313616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:15.114112 run osmo-stp_10.42.42.5(pid=22089): stdout: | (launched: 2022-12-12_20:03:13.429055) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:15.243058 run osmo-stp_10.42.42.5(pid=22089): stderr: | 20221212200313615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200313615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200313615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200313616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200313616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200313616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200313616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:15.397194 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22089): Process ended prematurely: osmo-stp_10.42.42.5(pid=22089) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22089)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:03:15.406948 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:03:15.435908 run osmo-hlr_10.42.42.2(pid=22086): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22086)] 20:03:15.486291 run osmo-hlr_10.42.42.2(pid=22086): stdout: | (launched: 2022-12-12_20:03:12.421802) 20:03:15.538491 run osmo-hlr_10.42.42.2(pid=22086): stderr: | 20221212200312616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200312616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200312616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200312616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200312616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200312616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200312630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200312640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200312640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200312640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:03:15.611050 run osmo-msc_10.42.42.6(pid=22092): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22092)] 20:03:15.661357 run osmo-msc_10.42.42.6(pid=22092): stdout: | (launched: 2022-12-12_20:03:14.463787) 20:03:15.713899 run osmo-msc_10.42.42.6(pid=22092): stderr: | 20221212200314780 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200314780 DLGLOBAL DEBUG validating counter group 0x7f80e72d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200314781 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200314781 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200314781 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200314781 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200314783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200314783 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200314783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200314783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:03:15.766345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22085): Terminating (SIGTERM) 20:03:15.808604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22088): Terminating (SIGTERM) 20:03:15.855826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22091): Terminating (SIGTERM) 20:03:15.923546 --- ParallelTerminationStrategy: PID 22085 died... 20:03:15.943196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22085): Terminated: ok {rc=0} 20:03:15.989427 --- ParallelTerminationStrategy: PID 22088 died... 20:03:16.009368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22088): Terminated: ok {rc=0} 20:03:16.055705 --- ParallelTerminationStrategy: PID 22091 died... 20:03:16.075243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22091): Terminated: ok {rc=0} 20:03:16.160236 bus /sierra_3: Setting Powered False 20:03:17.257331 bus /sierra_3: Setting Powered False 20:03:18.372068 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:03:19.515407 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:19.527075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:03:19.592309 tst mo_mt_call_osmux.py: using LAC 31175 20:03:19.709396 tst mo_mt_call_osmux.py: using RAC 65 20:03:19.826506 tst mo_mt_call_osmux.py: using CellId 31175 20:03:19.953462 tst mo_mt_call_osmux.py: using BVCI 31176 20:03:20.073339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:20.085275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:20.096910 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:20.108768 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:20.122213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:03:20.134541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:03:20.254128 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:03:20.372528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:03:20.840123 run create_hlr_db(pid=22094): Launched 20:03:20.963740 bus /sierra_2: Setting Powered False 20:03:22.025221 run create_hlr_db(pid=22094): Terminated: ok {rc=0} 20:03:22.466537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22096): Launched 20:03:22.790653 run osmo-hlr_10.42.42.2(pid=22097): Launched 20:03:22.914126 run osmo-stp_10.42.42.5: Starting osmo-stp 20:03:23.468045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22099): Launched 20:03:23.791242 run osmo-stp_10.42.42.5(pid=22100): Launched 20:03:23.913932 run osmo-msc_10.42.42.6: Starting osmo-msc 20:03:24.497168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22102): Launched 20:03:24.820771 run osmo-msc_10.42.42.6(pid=22103): Launched 20:03:24.990762 run osmo-stp_10.42.42.5(pid=22100): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22100)] 20:03:25.119575 run osmo-stp_10.42.42.5(pid=22100): stdout: | (launched: 2022-12-12_20:03:23.731384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:25.248104 run osmo-stp_10.42.42.5(pid=22100): stderr: | 20221212200323919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200323919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200323919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200323920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200323920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200323921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200323921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:25.374694 run osmo-stp_10.42.42.5(pid=22100): stdout: | (launched: 2022-12-12_20:03:23.731384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:25.494775 run osmo-stp_10.42.42.5(pid=22100): stderr: | 20221212200323919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200323919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200323919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200323920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200323920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200323921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200323921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:25.638189 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22100): Process ended prematurely: osmo-stp_10.42.42.5(pid=22100) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22100)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:03:25.647029 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:03:25.673933 run osmo-hlr_10.42.42.2(pid=22097): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22097)] 20:03:25.721912 run osmo-hlr_10.42.42.2(pid=22097): stdout: | (launched: 2022-12-12_20:03:22.731144) 20:03:25.771613 run osmo-hlr_10.42.42.2(pid=22097): stderr: | 20221212200322924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200322924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200322924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200322924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200322924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200322924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200322936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200322944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200322944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200322945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:03:25.841237 run osmo-msc_10.42.42.6(pid=22103): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22103)] 20:03:25.889055 run osmo-msc_10.42.42.6(pid=22103): stdout: | (launched: 2022-12-12_20:03:24.761229) 20:03:25.938745 run osmo-msc_10.42.42.6(pid=22103): stderr: | 20221212200325032 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200325032 DLGLOBAL DEBUG validating counter group 0x7fd161e40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200325032 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200325032 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200325032 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200325033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200325034 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200325035 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200325035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200325035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:03:25.988525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22096): Terminating (SIGTERM) 20:03:26.028012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22099): Terminating (SIGTERM) 20:03:26.067691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22102): Terminating (SIGTERM) 20:03:26.108109 --- ParallelTerminationStrategy: PID 22096 died... 20:03:26.127481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22096): Terminated: ok {rc=0} 20:03:26.171710 --- ParallelTerminationStrategy: PID 22099 died... 20:03:26.190761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22099): Terminated: ok {rc=0} 20:03:26.235405 --- ParallelTerminationStrategy: PID 22102 died... 20:03:26.254406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22102): Terminated: ok {rc=0} 20:03:26.340584 bus /sierra_3: Setting Powered False 20:03:27.439942 bus /sierra_3: Setting Powered False 20:03:28.555300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:03:29.800906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:03:29.807302 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:03:29.836481 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:03:29.862939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:03:29.914943 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:03:29.943746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:03:29.969844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:03:30.520670 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:03:30.569073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:30.580394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:03:30.648454 tst mo_mt_call.py: using LAC 31176 20:03:30.765839 tst mo_mt_call.py: using RAC 66 20:03:30.887497 tst mo_mt_call.py: using CellId 31176 20:03:31.024046 tst mo_mt_call.py: using BVCI 31177 20:03:31.184426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:31.200619 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:31.218405 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:31.230338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:31.242419 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:31.254516 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:03:31.390700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:03:31.541681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:03:32.043053 run create_hlr_db(pid=22108): Launched 20:03:32.203623 bus /sierra_2: Setting Powered False 20:03:33.263315 run create_hlr_db(pid=22108): Terminated: ok {rc=0} 20:03:33.705387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22110): Launched 20:03:34.028387 run osmo-hlr_10.42.42.2(pid=22111): Launched 20:03:34.151379 run osmo-stp_10.42.42.5: Starting osmo-stp 20:03:34.701750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22113): Launched 20:03:35.025224 run osmo-stp_10.42.42.5(pid=22114): Launched 20:03:35.147710 run osmo-msc_10.42.42.6: Starting osmo-msc 20:03:35.729683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22116): Launched 20:03:36.052474 run osmo-msc_10.42.42.6(pid=22117): Launched 20:03:36.231843 run osmo-stp_10.42.42.5(pid=22114): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22114)] 20:03:36.366957 run osmo-stp_10.42.42.5(pid=22114): stdout: | (launched: 2022-12-12_20:03:34.965786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:36.503244 run osmo-stp_10.42.42.5(pid=22114): stderr: | 20221212200335156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200335156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200335156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200335156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200335157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200335157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200335157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:36.638727 run osmo-stp_10.42.42.5(pid=22114): stdout: | (launched: 2022-12-12_20:03:34.965786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:36.767648 run osmo-stp_10.42.42.5(pid=22114): stderr: | 20221212200335156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200335156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200335156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200335156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200335157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200335157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200335157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:36.921340 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22114): Process ended prematurely: osmo-stp_10.42.42.5(pid=22114) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22114)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:03:36.931148 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:03:36.959807 run osmo-hlr_10.42.42.2(pid=22111): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22111)] 20:03:37.010927 run osmo-hlr_10.42.42.2(pid=22111): stdout: | (launched: 2022-12-12_20:03:33.968904) 20:03:37.063120 run osmo-hlr_10.42.42.2(pid=22111): stderr: | 20221212200334163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200334163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200334163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200334163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200334163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200334163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200334176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200334184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200334184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200334184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:03:37.135796 run osmo-msc_10.42.42.6(pid=22117): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22117)] 20:03:37.186173 run osmo-msc_10.42.42.6(pid=22117): stdout: | (launched: 2022-12-12_20:03:35.992788) 20:03:37.238105 run osmo-msc_10.42.42.6(pid=22117): stderr: | 20221212200336312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200336313 DLGLOBAL DEBUG validating counter group 0x7f54499a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200336313 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200336313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200336313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200336313 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200336315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200336315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200336315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200336315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:03:37.290479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22110): Terminating (SIGTERM) 20:03:37.332638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22113): Terminating (SIGTERM) 20:03:37.375100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22116): Terminating (SIGTERM) 20:03:37.417729 --- ParallelTerminationStrategy: PID 22110 died... 20:03:37.438029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22110): Terminated: ok {rc=0} 20:03:37.485614 --- ParallelTerminationStrategy: PID 22113 died... 20:03:37.505547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22113): Terminated: ok {rc=0} 20:03:37.552873 --- ParallelTerminationStrategy: PID 22116 died... 20:03:37.572774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22116): Terminated: ok {rc=0} 20:03:37.661774 bus /sierra_3: Setting Powered False 20:03:38.760666 bus /sierra_3: Setting Powered False 20:03:39.876221 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:03:41.017353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:41.029243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:03:41.094822 tst mo_mt_call_osmux.py: using LAC 31177 20:03:41.218177 tst mo_mt_call_osmux.py: using RAC 67 20:03:41.336894 tst mo_mt_call_osmux.py: using CellId 31177 20:03:41.453384 tst mo_mt_call_osmux.py: using BVCI 31178 20:03:41.561270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:41.572498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:41.583782 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:41.594984 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:41.606343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:03:41.617491 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:03:41.735369 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:03:41.852116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:03:42.318536 run create_hlr_db(pid=22119): Launched 20:03:42.441991 bus /sierra_2: Setting Powered False 20:03:43.502281 run create_hlr_db(pid=22119): Terminated: ok {rc=0} 20:03:43.943456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22121): Launched 20:03:44.266508 run osmo-hlr_10.42.42.2(pid=22122): Launched 20:03:44.390175 run osmo-stp_10.42.42.5: Starting osmo-stp 20:03:44.946023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22124): Launched 20:03:45.268737 run osmo-stp_10.42.42.5(pid=22125): Launched 20:03:45.391836 run osmo-msc_10.42.42.6: Starting osmo-msc 20:03:46.015483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22127): Launched 20:03:46.342375 run osmo-msc_10.42.42.6(pid=22128): Launched 20:03:46.694390 run osmo-stp_10.42.42.5(pid=22125): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22125)] 20:03:46.959550 run osmo-stp_10.42.42.5(pid=22125): stdout: | (launched: 2022-12-12_20:03:45.209430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:47.223520 run osmo-stp_10.42.42.5(pid=22125): stderr: | 20221212200345397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200345398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200345398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200345398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200345399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200345399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200345399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:47.358911 run osmo-stp_10.42.42.5(pid=22125): stdout: | (launched: 2022-12-12_20:03:45.209430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:47.487560 run osmo-stp_10.42.42.5(pid=22125): stderr: | 20221212200345397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200345398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200345398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200345398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200345399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200345399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200345399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:47.641463 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22125): Process ended prematurely: osmo-stp_10.42.42.5(pid=22125) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22125)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:03:47.651114 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:03:47.680543 run osmo-hlr_10.42.42.2(pid=22122): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22122)] 20:03:47.731801 run osmo-hlr_10.42.42.2(pid=22122): stdout: | (launched: 2022-12-12_20:03:44.207107) 20:03:47.784823 run osmo-hlr_10.42.42.2(pid=22122): stderr: | 20221212200344401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200344401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200344401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200344401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200344401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200344401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200344438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200344448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200344448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200344449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:03:47.858189 run osmo-msc_10.42.42.6(pid=22128): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22128)] 20:03:47.909067 run osmo-msc_10.42.42.6(pid=22128): stdout: | (launched: 2022-12-12_20:03:46.281234) 20:03:47.961384 run osmo-msc_10.42.42.6(pid=22128): stderr: | 20221212200346878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200346878 DLGLOBAL DEBUG validating counter group 0x7fb1e3c43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200346879 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200346879 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200346879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200346879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200346881 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200346881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200346881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200346882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:03:48.014866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22121): Terminating (SIGTERM) 20:03:48.057294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22124): Terminating (SIGTERM) 20:03:48.099951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22127): Terminating (SIGTERM) 20:03:48.142954 --- ParallelTerminationStrategy: PID 22121 died... 20:03:48.163230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22121): Terminated: ok {rc=0} 20:03:48.211035 --- ParallelTerminationStrategy: PID 22124 died... 20:03:48.231093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22124): Terminated: ok {rc=0} 20:03:48.278645 --- ParallelTerminationStrategy: PID 22127 died... 20:03:48.298487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22127): Terminated: ok {rc=0} 20:03:48.387491 bus /sierra_3: Setting Powered False 20:03:49.487487 bus /sierra_3: Setting Powered False 20:03:50.603474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:03:51.849269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:03:51.855596 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:03:51.884378 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:03:51.910653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:03:51.963435 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:03:51.993048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:03:52.019046 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:03:52.573553 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:03:52.621754 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:03:52.633106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:03:52.698094 tst mo_mt_call.py: using LAC 31178 20:03:52.828591 tst mo_mt_call.py: using RAC 68 20:03:52.954717 tst mo_mt_call.py: using CellId 31178 20:03:53.081313 tst mo_mt_call.py: using BVCI 31179 20:03:53.198365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:03:53.210273 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:03:53.221968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:03:53.234210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:03:53.246307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:03:53.258270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:03:53.373308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:03:53.491269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:03:53.992061 run create_hlr_db(pid=22133): Launched 20:03:54.114821 bus /sierra_2: Setting Powered False 20:03:55.179144 run create_hlr_db(pid=22133): Terminated: ok {rc=0} 20:03:55.610617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22135): Launched 20:03:55.911979 run osmo-hlr_10.42.42.2(pid=22136): Launched 20:03:56.026677 run osmo-stp_10.42.42.5: Starting osmo-stp 20:03:56.555258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22138): Launched 20:03:56.856192 run osmo-stp_10.42.42.5(pid=22139): Launched 20:03:56.970059 run osmo-msc_10.42.42.6: Starting osmo-msc 20:03:57.512647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22141): Launched 20:03:57.814824 run osmo-msc_10.42.42.6(pid=22142): Launched 20:03:57.985343 run osmo-stp_10.42.42.5(pid=22139): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22139)] 20:03:58.111124 run osmo-stp_10.42.42.5(pid=22139): stdout: | (launched: 2022-12-12_20:03:56.800518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:58.237271 run osmo-stp_10.42.42.5(pid=22139): stderr: | 20221212200356968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200356968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200356968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200356969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200356969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200356969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200356970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:58.362187 run osmo-stp_10.42.42.5(pid=22139): stdout: | (launched: 2022-12-12_20:03:56.800518) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:58.481410 run osmo-stp_10.42.42.5(pid=22139): stderr: | 20221212200356968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200356968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200356968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200356969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200356969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200356969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200356970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:58.623926 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22139): Process ended prematurely: osmo-stp_10.42.42.5(pid=22139) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22139)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:03:58.632927 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:03:58.659848 run osmo-hlr_10.42.42.2(pid=22136): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22136)] 20:03:58.707761 run osmo-hlr_10.42.42.2(pid=22136): stdout: | (launched: 2022-12-12_20:03:55.856343) 20:03:58.757376 run osmo-hlr_10.42.42.2(pid=22136): stderr: | 20221212200356028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200356028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200356028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200356028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200356028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200356028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200356042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200356050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200356051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200356051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:03:58.826578 run osmo-msc_10.42.42.6(pid=22142): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22142)] 20:03:58.874133 run osmo-msc_10.42.42.6(pid=22142): stdout: | (launched: 2022-12-12_20:03:57.758921) 20:03:58.923258 run osmo-msc_10.42.42.6(pid=22142): stderr: | 20221212200358030 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200358030 DLGLOBAL DEBUG validating counter group 0x7f98eb8a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200358030 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200358030 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200358030 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200358030 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200358032 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200358033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200358033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200358033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:03:58.973709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22135): Terminating (SIGTERM) 20:03:59.013431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22138): Terminating (SIGTERM) 20:03:59.052861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22141): Terminating (SIGTERM) 20:03:59.092658 --- ParallelTerminationStrategy: PID 22135 died... 20:03:59.111657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22135): Terminated: ok {rc=0} 20:03:59.155939 --- ParallelTerminationStrategy: PID 22138 died... 20:03:59.174745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22138): Terminated: ok {rc=0} 20:03:59.218773 --- ParallelTerminationStrategy: PID 22141 died... 20:03:59.237637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22141): Terminated: ok {rc=0} 20:03:59.323397 bus /sierra_3: Setting Powered False 20:04:00.423279 bus /sierra_3: Setting Powered False 20:04:01.535825 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:04:02.677634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:04:02.689570 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:04:02.755937 tst mo_mt_call_osmux.py: using LAC 31179 20:04:02.874291 tst mo_mt_call_osmux.py: using RAC 69 20:04:02.992822 tst mo_mt_call_osmux.py: using CellId 31179 20:04:03.110683 tst mo_mt_call_osmux.py: using BVCI 31180 20:04:03.219056 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:04:03.230417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:04:03.241482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:04:03.252620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:04:03.263833 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:04:03.274977 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:04:03.395280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:04:03.511181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:04:04.011744 run create_hlr_db(pid=22144): Launched 20:04:04.135355 bus /sierra_2: Setting Powered False 20:04:05.199229 run create_hlr_db(pid=22144): Terminated: ok {rc=0} 20:04:05.632509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22146): Launched 20:04:05.935685 run osmo-hlr_10.42.42.2(pid=22147): Launched 20:04:06.050424 run osmo-stp_10.42.42.5: Starting osmo-stp 20:04:06.568926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22149): Launched 20:04:06.870877 run osmo-stp_10.42.42.5(pid=22151): Launched 20:04:06.985766 run osmo-msc_10.42.42.6: Starting osmo-msc 20:04:07.529603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22153): Launched 20:04:07.831198 run osmo-msc_10.42.42.6(pid=22154): Launched 20:04:07.999393 run osmo-stp_10.42.42.5(pid=22151): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22151)] 20:04:08.129245 run osmo-stp_10.42.42.5(pid=22151): stdout: | (launched: 2022-12-12_20:04:06.814911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:08.256090 run osmo-stp_10.42.42.5(pid=22151): stderr: | 20221212200406980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200406981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200406981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200406981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200406982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200406982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200406982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:08.381495 run osmo-stp_10.42.42.5(pid=22151): stdout: | (launched: 2022-12-12_20:04:06.814911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:08.501256 run osmo-stp_10.42.42.5(pid=22151): stderr: | 20221212200406980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200406981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200406981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200406981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200406982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200406982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200406982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:08.644338 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22151): Process ended prematurely: osmo-stp_10.42.42.5(pid=22151) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22151)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:04:08.653422 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:04:08.680511 run osmo-hlr_10.42.42.2(pid=22147): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22147)] 20:04:08.728754 run osmo-hlr_10.42.42.2(pid=22147): stdout: | (launched: 2022-12-12_20:04:05.879785) 20:04:08.778718 run osmo-hlr_10.42.42.2(pid=22147): stderr: | 20221212200406053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200406053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200406053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200406053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200406053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200406053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200406066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200406075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200406075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200406075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:04:08.848158 run osmo-msc_10.42.42.6(pid=22154): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22154)] 20:04:08.896035 run osmo-msc_10.42.42.6(pid=22154): stdout: | (launched: 2022-12-12_20:04:07.775015) 20:04:08.945532 run osmo-msc_10.42.42.6(pid=22154): stderr: | 20221212200408043 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200408044 DLGLOBAL DEBUG validating counter group 0x7faec6435c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200408044 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200408044 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200408044 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200408044 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200408046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200408046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200408047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200408047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:04:08.995682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22146): Terminating (SIGTERM) 20:04:09.035428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22149): Terminating (SIGTERM) 20:04:09.075605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22153): Terminating (SIGTERM) 20:04:09.116234 --- ParallelTerminationStrategy: PID 22146 died... 20:04:09.135715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22146): Terminated: ok {rc=0} 20:04:09.180359 --- ParallelTerminationStrategy: PID 22149 died... 20:04:09.199195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22149): Terminated: ok {rc=0} 20:04:09.244050 --- ParallelTerminationStrategy: PID 22153 died... 20:04:09.263082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22153): Terminated: ok {rc=0} 20:04:09.347819 bus /sierra_3: Setting Powered False 20:04:10.446982 bus /sierra_3: Setting Powered False 20:04:11.566704 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:04:12.816861 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:04:12.823942 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:04:12.854292 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:04:12.881352 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:04:12.936131 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:04:12.966147 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:04:12.993470 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:04:13.545457 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:04:13.597939 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:13.609854 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:04:13.680648 tst mo_mt_call.py: using LAC 31180 20:04:13.807752 tst mo_mt_call.py: using RAC 70 20:04:13.934466 tst mo_mt_call.py: using CellId 31180 20:04:14.062464 tst mo_mt_call.py: using BVCI 31181 20:04:14.181251 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:14.193071 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:14.204602 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:14.216587 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:14.228542 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:14.240377 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:04:14.357307 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:04:14.475828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:04:14.976144 run create_hlr_db(pid=22159): Launched 20:04:15.099783 bus /sierra_2: Setting Powered False 20:04:16.163424 run create_hlr_db(pid=22159): Terminated: ok {rc=0} 20:04:16.627374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22161): Launched 20:04:16.981718 run osmo-hlr_10.42.42.2(pid=22162): Launched 20:04:17.159806 run osmo-stp_10.42.42.5: Starting osmo-stp 20:04:17.716829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22164): Launched 20:04:18.040588 run osmo-stp_10.42.42.5(pid=22165): Launched 20:04:18.163325 run osmo-msc_10.42.42.6: Starting osmo-msc 20:04:18.748270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22167): Launched 20:04:19.071714 run osmo-msc_10.42.42.6(pid=22168): Launched 20:04:19.252227 run osmo-stp_10.42.42.5(pid=22165): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22165)] 20:04:19.388576 run osmo-stp_10.42.42.5(pid=22165): stdout: | (launched: 2022-12-12_20:04:17.980891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:19.525191 run osmo-stp_10.42.42.5(pid=22165): stderr: | 20221212200418168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200418168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200418168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200418169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200418169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200418169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200418169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:19.659718 run osmo-stp_10.42.42.5(pid=22165): stdout: | (launched: 2022-12-12_20:04:17.980891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:19.788595 run osmo-stp_10.42.42.5(pid=22165): stderr: | 20221212200418168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200418168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200418168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200418169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200418169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200418169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200418169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:19.942328 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22165): Process ended prematurely: osmo-stp_10.42.42.5(pid=22165) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22165)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:04:19.951761 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:04:19.980300 run osmo-hlr_10.42.42.2(pid=22162): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22162)] 20:04:20.030612 run osmo-hlr_10.42.42.2(pid=22162): stdout: | (launched: 2022-12-12_20:04:16.910105) 20:04:20.082670 run osmo-hlr_10.42.42.2(pid=22162): stderr: | 20221212200417180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200417180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200417180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200417180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200417180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200417180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200417193 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200417201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200417201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200417201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:04:20.155647 run osmo-msc_10.42.42.6(pid=22168): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22168)] 20:04:20.206241 run osmo-msc_10.42.42.6(pid=22168): stdout: | (launched: 2022-12-12_20:04:19.012151) 20:04:20.258234 run osmo-msc_10.42.42.6(pid=22168): stderr: | 20221212200419331 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200419332 DLGLOBAL DEBUG validating counter group 0x7f4fef28ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200419332 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200419332 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200419332 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200419332 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200419334 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200419334 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200419335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200419335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:04:20.310969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22161): Terminating (SIGTERM) 20:04:20.352896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22164): Terminating (SIGTERM) 20:04:20.394859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22167): Terminating (SIGTERM) 20:04:20.437224 --- ParallelTerminationStrategy: PID 22161 died... 20:04:20.457569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22161): Terminated: ok {rc=0} 20:04:20.504417 --- ParallelTerminationStrategy: PID 22164 died... 20:04:20.524160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22164): Terminated: ok {rc=0} 20:04:20.570841 --- ParallelTerminationStrategy: PID 22167 died... 20:04:20.590529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22167): Terminated: ok {rc=0} 20:04:20.679103 bus /sierra_3: Setting Powered False 20:04:21.778462 bus /sierra_3: Setting Powered False 20:04:22.894655 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:04:24.045037 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:24.057584 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:04:24.126119 tst mo_mt_call_osmux.py: using LAC 31181 20:04:24.253357 tst mo_mt_call_osmux.py: using RAC 71 20:04:24.379631 tst mo_mt_call_osmux.py: using CellId 31181 20:04:24.499717 tst mo_mt_call_osmux.py: using BVCI 31182 20:04:24.611151 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:24.622777 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:24.634355 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:24.645914 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:24.657565 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:04:24.669069 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:04:24.788100 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:04:24.908133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:04:25.407994 run create_hlr_db(pid=22170): Launched 20:04:25.532106 bus /sierra_2: Setting Powered False 20:04:26.595809 run create_hlr_db(pid=22170): Terminated: ok {rc=0} 20:04:27.027933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22172): Launched 20:04:27.330664 run osmo-hlr_10.42.42.2(pid=22173): Launched 20:04:27.445237 run osmo-stp_10.42.42.5: Starting osmo-stp 20:04:27.965725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22175): Launched 20:04:28.267403 run osmo-stp_10.42.42.5(pid=22176): Launched 20:04:28.382609 run osmo-msc_10.42.42.6: Starting osmo-msc 20:04:28.926541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22178): Launched 20:04:29.227487 run osmo-msc_10.42.42.6(pid=22179): Launched 20:04:29.395751 run osmo-stp_10.42.42.5(pid=22176): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22176)] 20:04:29.522547 run osmo-stp_10.42.42.5(pid=22176): stdout: | (launched: 2022-12-12_20:04:28.211282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:29.649258 run osmo-stp_10.42.42.5(pid=22176): stderr: | 20221212200428378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200428378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200428379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200428379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200428380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200428380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200428380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:29.774782 run osmo-stp_10.42.42.5(pid=22176): stdout: | (launched: 2022-12-12_20:04:28.211282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:29.894780 run osmo-stp_10.42.42.5(pid=22176): stderr: | 20221212200428378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200428378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200428379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200428379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200428380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200428380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200428380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:30.038218 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22176): Process ended prematurely: osmo-stp_10.42.42.5(pid=22176) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22176)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:04:30.047256 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:04:30.074472 run osmo-hlr_10.42.42.2(pid=22173): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22173)] 20:04:30.123098 run osmo-hlr_10.42.42.2(pid=22173): stdout: | (launched: 2022-12-12_20:04:27.274528) 20:04:30.173360 run osmo-hlr_10.42.42.2(pid=22173): stderr: | 20221212200427449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200427449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200427450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200427450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200427450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200427450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200427462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200427471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200427471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200427471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:04:30.243267 run osmo-msc_10.42.42.6(pid=22179): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22179)] 20:04:30.291321 run osmo-msc_10.42.42.6(pid=22179): stdout: | (launched: 2022-12-12_20:04:29.171413) 20:04:30.341163 run osmo-msc_10.42.42.6(pid=22179): stderr: | 20221212200429442 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200429442 DLGLOBAL DEBUG validating counter group 0x7f0324cb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200429442 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200429442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200429442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200429443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200429444 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200429445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200429445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200429445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:04:30.391391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22172): Terminating (SIGTERM) 20:04:30.431099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22175): Terminating (SIGTERM) 20:04:30.470686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22178): Terminating (SIGTERM) 20:04:30.511006 --- ParallelTerminationStrategy: PID 22172 died... 20:04:30.530360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22172): Terminated: ok {rc=0} 20:04:30.574779 --- ParallelTerminationStrategy: PID 22175 died... 20:04:30.593808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22175): Terminated: ok {rc=0} 20:04:30.638246 --- ParallelTerminationStrategy: PID 22178 died... 20:04:30.657215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22178): Terminated: ok {rc=0} 20:04:30.743900 bus /sierra_3: Setting Powered False 20:04:31.851542 bus /sierra_3: Setting Powered False 20:04:32.985580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:04:34.240642 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:04:34.246331 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:04:34.275259 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:04:34.301634 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:04:34.352072 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:04:34.381412 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:04:34.407592 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:04:34.958763 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:04:35.008052 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:35.019381 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:04:35.083833 tst mo_mt_call.py: using LAC 31182 20:04:35.200119 tst mo_mt_call.py: using RAC 72 20:04:35.316877 tst mo_mt_call.py: using CellId 31182 20:04:35.442714 tst mo_mt_call.py: using BVCI 31183 20:04:35.559723 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:35.571342 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:35.582755 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:35.594406 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:35.606164 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:35.617791 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:04:35.736725 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:04:35.852374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:04:36.319127 run create_hlr_db(pid=22185): Launched 20:04:36.442971 bus /sierra_2: Setting Powered False 20:04:37.503602 run create_hlr_db(pid=22185): Terminated: ok {rc=0} 20:04:37.924450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22187): Launched 20:04:38.225058 run osmo-hlr_10.42.42.2(pid=22188): Launched 20:04:38.339740 run osmo-stp_10.42.42.5: Starting osmo-stp 20:04:38.876445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22190): Launched 20:04:39.178367 run osmo-stp_10.42.42.5(pid=22191): Launched 20:04:39.293956 run osmo-msc_10.42.42.6: Starting osmo-msc 20:04:39.838388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22193): Launched 20:04:40.140544 run osmo-msc_10.42.42.6(pid=22194): Launched 20:04:40.308715 run osmo-stp_10.42.42.5(pid=22191): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22191)] 20:04:40.434994 run osmo-stp_10.42.42.5(pid=22191): stdout: | (launched: 2022-12-12_20:04:39.122040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:40.562376 run osmo-stp_10.42.42.5(pid=22191): stderr: | 20221212200439291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200439291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200439292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200439292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200439293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200439293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200439293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:40.687730 run osmo-stp_10.42.42.5(pid=22191): stdout: | (launched: 2022-12-12_20:04:39.122040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:40.807361 run osmo-stp_10.42.42.5(pid=22191): stderr: | 20221212200439291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200439291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200439292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200439292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200439293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200439293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200439293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:40.950630 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22191): Process ended prematurely: osmo-stp_10.42.42.5(pid=22191) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22191)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:04:40.959468 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:04:40.986384 run osmo-hlr_10.42.42.2(pid=22188): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22188)] 20:04:41.034143 run osmo-hlr_10.42.42.2(pid=22188): stdout: | (launched: 2022-12-12_20:04:38.169300) 20:04:41.083532 run osmo-hlr_10.42.42.2(pid=22188): stderr: | 20221212200438344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200438344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200438344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200438345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200438345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200438345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200438357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200438366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200438366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200438366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:04:41.152466 run osmo-msc_10.42.42.6(pid=22194): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22194)] 20:04:41.200106 run osmo-msc_10.42.42.6(pid=22194): stdout: | (launched: 2022-12-12_20:04:40.084381) 20:04:41.249338 run osmo-msc_10.42.42.6(pid=22194): stderr: | 20221212200440352 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200440352 DLGLOBAL DEBUG validating counter group 0x7f6a58d59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200440352 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200440352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200440353 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200440353 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200440355 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200440355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200440355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200440355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:04:41.299183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22187): Terminating (SIGTERM) 20:04:41.338559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22190): Terminating (SIGTERM) 20:04:41.377960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22193): Terminating (SIGTERM) 20:04:41.417709 --- ParallelTerminationStrategy: PID 22187 died... 20:04:41.436812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22187): Terminated: ok {rc=0} 20:04:41.480891 --- ParallelTerminationStrategy: PID 22190 died... 20:04:41.499893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22190): Terminated: ok {rc=0} 20:04:41.543806 --- ParallelTerminationStrategy: PID 22193 died... 20:04:41.562691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22193): Terminated: ok {rc=0} 20:04:41.648158 bus /sierra_3: Setting Powered False 20:04:42.748439 bus /sierra_3: Setting Powered False 20:04:43.862399 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:04:45.011045 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:45.023218 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:04:45.091792 tst mo_mt_call_osmux.py: using LAC 31183 20:04:45.217823 tst mo_mt_call_osmux.py: using RAC 73 20:04:45.343865 tst mo_mt_call_osmux.py: using CellId 31183 20:04:45.463859 tst mo_mt_call_osmux.py: using BVCI 31184 20:04:45.573216 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:45.584480 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:45.595608 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:45.606983 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:45.618437 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:04:45.629712 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:04:45.744584 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:04:45.874138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:04:46.367548 run create_hlr_db(pid=22196): Launched 20:04:46.525274 bus /sierra_2: Setting Powered False 20:04:47.585201 run create_hlr_db(pid=22196): Terminated: ok {rc=0} 20:04:48.007243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22198): Launched 20:04:48.309683 run osmo-hlr_10.42.42.2(pid=22199): Launched 20:04:48.424264 run osmo-stp_10.42.42.5: Starting osmo-stp 20:04:48.956928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22201): Launched 20:04:49.259052 run osmo-stp_10.42.42.5(pid=22202): Launched 20:04:49.374348 run osmo-msc_10.42.42.6: Starting osmo-msc 20:04:49.931213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22204): Launched 20:04:50.235241 run osmo-msc_10.42.42.6(pid=22205): Launched 20:04:50.404075 run osmo-stp_10.42.42.5(pid=22202): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22202)] 20:04:50.530377 run osmo-stp_10.42.42.5(pid=22202): stdout: | (launched: 2022-12-12_20:04:49.202387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:50.657187 run osmo-stp_10.42.42.5(pid=22202): stderr: | 20221212200449368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200449369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200449369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200449369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200449370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200449370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200449370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:50.782235 run osmo-stp_10.42.42.5(pid=22202): stdout: | (launched: 2022-12-12_20:04:49.202387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:04:50.901702 run osmo-stp_10.42.42.5(pid=22202): stderr: | 20221212200449368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200449369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200449369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200449369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200449370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200449370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200449370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:04:51.044307 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22202): Process ended prematurely: osmo-stp_10.42.42.5(pid=22202) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22202)] [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:04:51.053360 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:04:51.080246 run osmo-hlr_10.42.42.2(pid=22199): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22199)] 20:04:51.127978 run osmo-hlr_10.42.42.2(pid=22199): stdout: | (launched: 2022-12-12_20:04:48.253189) 20:04:51.177388 run osmo-hlr_10.42.42.2(pid=22199): stderr: | 20221212200448427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200448427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200448427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200448427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200448427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200448428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200448441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200448450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200448450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200448450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:04:51.246595 run osmo-msc_10.42.42.6(pid=22205): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22205)] 20:04:51.294041 run osmo-msc_10.42.42.6(pid=22205): stdout: | (launched: 2022-12-12_20:04:50.177997) 20:04:51.343193 run osmo-msc_10.42.42.6(pid=22205): stderr: | 20221212200450449 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200450449 DLGLOBAL DEBUG validating counter group 0x7f47f1fe5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200450449 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200450449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200450450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200450450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200450451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200450452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200450452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200450452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:04:51.392661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22198): Terminating (SIGTERM) 20:04:51.432283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22201): Terminating (SIGTERM) 20:04:51.471926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22204): Terminating (SIGTERM) 20:04:51.512134 --- ParallelTerminationStrategy: PID 22198 died... 20:04:51.531422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22198): Terminated: ok {rc=0} 20:04:51.575595 --- ParallelTerminationStrategy: PID 22201 died... 20:04:51.594415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22201): Terminated: ok {rc=0} 20:04:51.639061 --- ParallelTerminationStrategy: PID 22204 died... 20:04:51.657958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22204): Terminated: ok {rc=0} 20:04:51.741053 bus /sierra_3: Setting Powered False 20:04:52.839207 bus /sierra_3: Setting Powered False 20:04:53.956721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 20:04:55.200344 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:04:55.204525 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:04:55.233618 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:04:55.260022 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 20:04:55.344157 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:04:55.372615 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:04:55.398618 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 20:04:55.984271 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 20:04:55.989222 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:04:56.000176 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:04:56.045099 tst emergency_mo_mt_call.py: using LAC 31184 20:04:56.160136 tst emergency_mo_mt_call.py: using RAC 74 20:04:56.275569 tst emergency_mo_mt_call.py: using CellId 31184 20:04:56.390767 tst emergency_mo_mt_call.py: using BVCI 31185 20:04:56.498438 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:04:56.509432 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:04:56.520098 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:04:56.530862 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:04:56.541526 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:04:56.552109 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:04:56.668767 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:04:56.788088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:04:57.280873 run create_hlr_db(pid=22210): Launched 20:04:57.402448 bus /sierra_2: Setting Powered False 20:04:58.465930 run create_hlr_db(pid=22210): Terminated: ok {rc=0} 20:04:58.891951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22212): Launched 20:04:59.188012 run osmo-hlr_10.42.42.2(pid=22213): Launched 20:04:59.302876 run osmo-stp_10.42.42.5: Starting osmo-stp 20:04:59.812601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22215): Launched 20:05:00.108165 run osmo-stp_10.42.42.5(pid=22216): Launched 20:05:00.228596 tst emergency_mo_mt_call.py: using MSISDN 7942 20:05:00.378042 run osmo-msc_10.42.42.6: Starting osmo-msc 20:05:00.931935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22218): Launched 20:05:01.240297 run osmo-msc_10.42.42.6(pid=22219): Launched 20:05:01.648299 run osmo-stp_10.42.42.5(pid=22216): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22216)] 20:05:02.044461 run osmo-stp_10.42.42.5(pid=22216): stdout: | (launched: 2022-12-12_20:05:00.053646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:02.285437 run osmo-stp_10.42.42.5(pid=22216): stderr: | 20221212200500218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200500218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200500219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200500219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200500220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200500220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200500220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:02.422047 run osmo-stp_10.42.42.5(pid=22216): stdout: | (launched: 2022-12-12_20:05:00.053646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:02.552315 run osmo-stp_10.42.42.5(pid=22216): stderr: | 20221212200500218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200500218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200500219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200500219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200500220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200500220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200500220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:02.705424 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22216): Process ended prematurely: osmo-stp_10.42.42.5(pid=22216) [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22216)] [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 20:05:02.714567 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 20:05:02.744438 run osmo-hlr_10.42.42.2(pid=22213): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22213)] 20:05:02.796649 run osmo-hlr_10.42.42.2(pid=22213): stdout: | (launched: 2022-12-12_20:04:59.132720) 20:05:02.850507 run osmo-hlr_10.42.42.2(pid=22213): stderr: | 20221212200459303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200459303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200459303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200459304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200459304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200459304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200459319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200459328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200459329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200459329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:05:02.924628 run osmo-msc_10.42.42.6(pid=22219): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22219)] 20:05:02.976184 run osmo-msc_10.42.42.6(pid=22219): stdout: | (launched: 2022-12-12_20:05:01.180669) 20:05:03.029579 run osmo-msc_10.42.42.6(pid=22219): stderr: | 20221212200501761 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200501762 DLGLOBAL DEBUG validating counter group 0x7fce5fe27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200501762 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200501762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200501763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200501764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200501768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200501769 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200501770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200501770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:05:03.083655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22212): Terminating (SIGTERM) 20:05:03.126779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22215): Terminating (SIGTERM) 20:05:03.169858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22218): Terminating (SIGTERM) 20:05:03.213434 --- ParallelTerminationStrategy: PID 22212 died... 20:05:03.233496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22212): Terminated: ok {rc=0} 20:05:03.281954 --- ParallelTerminationStrategy: PID 22215 died... 20:05:03.301989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22215): Terminated: ok {rc=0} 20:05:03.350938 --- ParallelTerminationStrategy: PID 22218 died... 20:05:03.370949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22218): Terminated: ok {rc=0} 20:05:03.461702 bus /sierra_3: Setting Powered False 20:05:04.560929 bus /sierra_3: Setting Powered False 20:05:05.678232 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 20:05:06.765041 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:05:06.777510 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:05:06.827529 tst emergency_preemptive_call.py: using LAC 31185 20:05:06.946273 tst emergency_preemptive_call.py: using RAC 75 20:05:07.063627 tst emergency_preemptive_call.py: using CellId 31185 20:05:07.179571 tst emergency_preemptive_call.py: using BVCI 31186 20:05:07.286382 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:05:07.297465 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:05:07.308082 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:05:07.319252 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:05:07.330528 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:05:07.341728 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:07.460032 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:07.574450 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:07.690568 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:07.807396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:05:08.266716 run create_hlr_db(pid=22224): Launched 20:05:08.389436 bus /sierra_2: Setting Powered False 20:05:09.449463 run create_hlr_db(pid=22224): Terminated: ok {rc=0} 20:05:09.863854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22226): Launched 20:05:10.160305 run osmo-hlr_10.42.42.2(pid=22227): Launched 20:05:10.271373 run osmo-stp_10.42.42.5: Starting osmo-stp 20:05:10.777606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22229): Launched 20:05:11.072587 run osmo-stp_10.42.42.5(pid=22230): Launched 20:05:11.194356 tst emergency_preemptive_call.py: using MSISDN 7943 20:05:11.343547 run osmo-msc_10.42.42.6: Starting osmo-msc 20:05:11.873184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22232): Launched 20:05:12.169460 run osmo-msc_10.42.42.6(pid=22233): Launched 20:05:12.334935 run osmo-stp_10.42.42.5(pid=22230): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22230)] 20:05:12.459660 run osmo-stp_10.42.42.5(pid=22230): stdout: | (launched: 2022-12-12_20:05:11.017415) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:12.584429 run osmo-stp_10.42.42.5(pid=22230): stderr: | 20221212200511183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200511183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200511184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200511184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200511184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200511185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200511185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:12.707730 run osmo-stp_10.42.42.5(pid=22230): stdout: | (launched: 2022-12-12_20:05:11.017415) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:12.825413 run osmo-stp_10.42.42.5(pid=22230): stderr: | 20221212200511183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200511183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200511184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200511184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200511184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200511185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200511185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:12.965997 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22230): Process ended prematurely: osmo-stp_10.42.42.5(pid=22230) [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22230)] [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 20:05:12.974390 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 20:05:13.000892 run osmo-hlr_10.42.42.2(pid=22227): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22227)] 20:05:13.048793 run osmo-hlr_10.42.42.2(pid=22227): stdout: | (launched: 2022-12-12_20:05:10.105328) 20:05:13.098466 run osmo-hlr_10.42.42.2(pid=22227): stderr: | 20221212200510279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200510279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200510279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200510279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200510280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200510280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200510292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200510301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200510301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200510301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:05:13.167776 run osmo-msc_10.42.42.6(pid=22233): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22233)] 20:05:13.215426 run osmo-msc_10.42.42.6(pid=22233): stdout: | (launched: 2022-12-12_20:05:12.113970) 20:05:13.264577 run osmo-msc_10.42.42.6(pid=22233): stderr: | 20221212200512382 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200512382 DLGLOBAL DEBUG validating counter group 0x7f3cf9845c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200512382 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200512382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200512382 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200512383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200512384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200512385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200512385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200512385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:05:13.314249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22226): Terminating (SIGTERM) 20:05:13.353664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22229): Terminating (SIGTERM) 20:05:13.393134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22232): Terminating (SIGTERM) 20:05:13.432890 --- ParallelTerminationStrategy: PID 22226 died... 20:05:13.452216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22226): Terminated: ok {rc=0} 20:05:13.496406 --- ParallelTerminationStrategy: PID 22229 died... 20:05:13.515235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22229): Terminated: ok {rc=0} 20:05:13.559059 --- ParallelTerminationStrategy: PID 22232 died... 20:05:13.577829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22232): Terminated: ok {rc=0} 20:05:13.661737 bus /sierra_9: Setting Powered False 20:05:14.760198 bus /sierra_9: Setting Powered False 20:05:15.930172 bus /sierra_8: Setting Powered False 20:05:17.035390 bus /sierra_8: Setting Powered False 20:05:18.155263 bus /sierra_3: Setting Powered False 20:05:19.253640 bus /sierra_3: Setting Powered False 20:05:20.373361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 20:05:21.651155 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:05:21.655911 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:05:21.686383 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 20:05:21.726160 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 20:05:21.815199 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:05:21.845432 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 20:05:21.884878 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 20:05:22.476709 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 20:05:22.529859 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:22.541034 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:05:22.589646 tst cs_paging_gprs_active.py: using LAC 31186 20:05:22.715432 tst cs_paging_gprs_active.py: using RAC 76 20:05:22.833565 tst cs_paging_gprs_active.py: using CellId 31186 20:05:22.949892 tst cs_paging_gprs_active.py: using BVCI 31187 20:05:23.058887 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.069954 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.080730 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.091698 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.102527 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.113253 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.124057 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.134780 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:23.145711 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:23.263281 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:23.382940 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:05:23.602047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:05:23.929676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22238): Launched 20:05:24.214699 run iperf3-srv_10.42.42.10(pid=22239): Launched 20:05:24.337263 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:05:24.556334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:05:24.883890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22240): Launched 20:05:25.167528 run iperf3-srv_10.42.42.10(pid=22241): Launched 20:05:25.289681 tst cs_paging_gprs_active.py:38: start network... 20:05:25.508463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:05:26.011021 run create_hlr_db(pid=22242): Launched 20:05:26.135836 bus /sierra_2: Setting Powered False 20:05:27.199962 run create_hlr_db(pid=22242): Terminated: ok {rc=0} 20:05:27.633058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22244): Launched 20:05:27.935990 run osmo-hlr_10.42.42.2(pid=22245): Launched 20:05:28.050736 run osmo-stp_10.42.42.5: Starting osmo-stp 20:05:28.584737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22247): Launched 20:05:28.887463 run osmo-stp_10.42.42.5(pid=22248): Launched 20:05:29.001925 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:05:29.522028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22250): Launched 20:05:29.637687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:05:29.893361 run patchelf(pid=22251): Launched 20:05:30.062897 run osmo-stp_10.42.42.5(pid=22248): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22248)] 20:05:30.191307 run osmo-stp_10.42.42.5(pid=22248): stdout: | (launched: 2022-12-12_20:05:28.831025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:30.321740 run osmo-stp_10.42.42.5(pid=22248): stderr: | 20221212200528998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200528998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200528998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200528999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200528999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200528999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200528999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:30.451982 run osmo-stp_10.42.42.5(pid=22248): stdout: | (launched: 2022-12-12_20:05:28.831025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:30.575876 run osmo-stp_10.42.42.5(pid=22248): stderr: | 20221212200528998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200528998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200528998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200528999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200528999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200528999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200528999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:30.722289 run patchelf(pid=22251): Terminating (SIGINT) 20:05:30.912663 run patchelf(pid=22251): Terminated: ok {rc=0} 20:05:31.049706 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22248): Process ended prematurely: osmo-stp_10.42.42.5(pid=22248) [trial-2381↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22248)] [trial-2381↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 20:05:31.061071 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:05:31.093789 run osmo-hlr_10.42.42.2(pid=22245): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22245)] 20:05:31.146766 run osmo-hlr_10.42.42.2(pid=22245): stdout: | (launched: 2022-12-12_20:05:27.879704) 20:05:31.201845 run osmo-hlr_10.42.42.2(pid=22245): stderr: | 20221212200528053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200528053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200528053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200528053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200528054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200528054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200528066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200528075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200528075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200528075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:05:31.258047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22238): Terminating (SIGTERM) 20:05:31.302706 run iperf3-srv_10.42.42.10(pid=22239): Terminating (SIGTERM) 20:05:31.353613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22240): Terminating (SIGTERM) 20:05:31.404105 run iperf3-srv_10.42.42.10(pid=22241): Terminating (SIGTERM) 20:05:31.456856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22244): Terminating (SIGTERM) 20:05:31.507270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22247): Terminating (SIGTERM) 20:05:31.557081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22250): Terminating (SIGTERM) 20:05:31.605772 --- ParallelTerminationStrategy: PID 22238 died... 20:05:31.629247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22238): Terminated: ok {rc=0} 20:05:31.684217 --- ParallelTerminationStrategy: PID 22239 died... 20:05:31.707877 run iperf3-srv_10.42.42.10(pid=22239): Terminated {rc=256} 20:05:31.762631 --- ParallelTerminationStrategy: PID 22240 died... 20:05:31.786315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22240): Terminated: ok {rc=0} 20:05:31.839958 --- ParallelTerminationStrategy: PID 22241 died... 20:05:31.863939 run iperf3-srv_10.42.42.10(pid=22241): Terminated {rc=256} 20:05:31.919187 --- ParallelTerminationStrategy: PID 22244 died... 20:05:31.943116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22244): Terminated: ok {rc=0} 20:05:31.996827 --- ParallelTerminationStrategy: PID 22247 died... 20:05:32.020650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22247): Terminated: ok {rc=0} 20:05:32.075811 --- ParallelTerminationStrategy: PID 22250 died... 20:05:32.100124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22250): Terminated: ok {rc=0} 20:05:32.209170 bus /gobi_0: Setting Powered False 20:05:33.304469 bus /gobi_0: Setting Powered False 20:05:34.419339 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 20:05:35.566092 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:35.577707 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:05:35.626404 tst iperf3.py: using LAC 31187 20:05:35.746724 tst iperf3.py: using RAC 77 20:05:35.869239 tst iperf3.py: using CellId 31187 20:05:35.987320 tst iperf3.py: using BVCI 31188 20:05:36.096502 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.107608 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.118466 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.129478 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.140297 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.151112 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.162161 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.173022 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:36.183978 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:36.304802 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:05:36.524131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:05:36.852221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22252): Launched 20:05:37.137095 run iperf3-srv_10.42.42.10(pid=22253): Launched 20:05:37.259248 tst iperf3.py:8: start network... 20:05:37.478489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:05:37.981800 run create_hlr_db(pid=22254): Launched 20:05:38.106108 bus /gobi_6: Setting Powered False 20:05:39.170317 run create_hlr_db(pid=22254): Terminated: ok {rc=0} 20:05:39.603017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22257): Launched 20:05:39.904614 run osmo-hlr_10.42.42.2(pid=22258): Launched 20:05:40.020569 run osmo-stp_10.42.42.5: Starting osmo-stp 20:05:40.539912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22260): Launched 20:05:40.841641 run osmo-stp_10.42.42.5(pid=22261): Launched 20:05:40.956553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:05:41.474226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22263): Launched 20:05:41.589564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:05:41.845945 run patchelf(pid=22264): Launched 20:05:42.014366 run osmo-stp_10.42.42.5(pid=22261): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22261)] 20:05:42.141823 run osmo-stp_10.42.42.5(pid=22261): stdout: | (launched: 2022-12-12_20:05:40.785321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:42.271293 run osmo-stp_10.42.42.5(pid=22261): stderr: | 20221212200540952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200540953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200540953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200540953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200540954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200540954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200540954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:42.401360 run osmo-stp_10.42.42.5(pid=22261): stdout: | (launched: 2022-12-12_20:05:40.785321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:42.524294 run osmo-stp_10.42.42.5(pid=22261): stderr: | 20221212200540952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200540953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200540953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200540953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200540954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200540954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200540954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:42.670198 run patchelf(pid=22264): Terminating (SIGINT) 20:05:42.838694 run patchelf(pid=22264): Terminated: ok {rc=0} 20:05:42.960907 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22261): Process ended prematurely: osmo-stp_10.42.42.5(pid=22261) [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22261)] [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 20:05:42.970319 tst iperf3.py:8: Test FAILED (7.4 sec) 20:05:42.997622 run osmo-hlr_10.42.42.2(pid=22258): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22258)] 20:05:43.044765 run osmo-hlr_10.42.42.2(pid=22258): stdout: | (launched: 2022-12-12_20:05:39.848193) 20:05:43.093869 run osmo-hlr_10.42.42.2(pid=22258): stderr: | 20221212200540021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200540021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200540021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200540022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200540022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200540022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200540034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200540042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200540042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200540042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:05:43.143483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22252): Terminating (SIGTERM) 20:05:43.183344 run iperf3-srv_10.42.42.10(pid=22253): Terminating (SIGTERM) 20:05:43.222629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22257): Terminating (SIGTERM) 20:05:43.261802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22260): Terminating (SIGTERM) 20:05:43.300989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22263): Terminating (SIGTERM) 20:05:43.340270 --- ParallelTerminationStrategy: PID 22252 died... 20:05:43.359476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22252): Terminated: ok {rc=0} 20:05:43.403759 --- ParallelTerminationStrategy: PID 22253 died... 20:05:43.422870 run iperf3-srv_10.42.42.10(pid=22253): Terminated {rc=256} 20:05:43.466824 --- ParallelTerminationStrategy: PID 22257 died... 20:05:43.485711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22257): Terminated: ok {rc=0} 20:05:43.529746 --- ParallelTerminationStrategy: PID 22260 died... 20:05:43.548512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22260): Terminated: ok {rc=0} 20:05:43.593469 --- ParallelTerminationStrategy: PID 22263 died... 20:05:43.612398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22263): Terminated: ok {rc=0} 20:05:43.695785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 20:05:44.846700 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:44.858697 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:05:44.906546 tst iperf3m4.py: using LAC 31188 20:05:45.034348 tst iperf3m4.py: using RAC 78 20:05:45.161803 tst iperf3m4.py: using CellId 31188 20:05:45.296076 tst iperf3m4.py: using BVCI 31189 20:05:45.415174 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.426698 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.437933 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.449561 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.461154 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.472602 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.484444 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.495947 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:05:45.507664 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:45.628070 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:45.745246 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:45.884368 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:05:46.012493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:05:46.245414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:05:46.578420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22265): Launched 20:05:46.879407 run iperf3-srv_10.42.42.10(pid=22266): Launched 20:05:47.027943 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:05:47.265310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:05:47.594251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22267): Launched 20:05:47.877531 run iperf3-srv_10.42.42.10(pid=22268): Launched 20:05:47.999431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:05:48.217269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:05:48.543223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Launched 20:05:48.826258 run iperf3-srv_10.42.42.10(pid=22270): Launched 20:05:48.948441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:05:49.166865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:05:49.493199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22271): Launched 20:05:49.776219 run iperf3-srv_10.42.42.10(pid=22272): Launched 20:05:49.898917 tst iperf3m4.py:8: start network... 20:05:50.117460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:05:50.619767 run create_hlr_db(pid=22273): Launched 20:05:50.743379 bus /gobi_6: Setting Powered False 20:05:51.807926 run create_hlr_db(pid=22273): Terminated: ok {rc=0} 20:05:52.240337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22275): Launched 20:05:52.543625 run osmo-hlr_10.42.42.2(pid=22276): Launched 20:05:52.659738 run osmo-stp_10.42.42.5: Starting osmo-stp 20:05:53.307891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22278): Launched 20:05:53.603904 run osmo-stp_10.42.42.5(pid=22279): Launched 20:05:53.716499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:05:54.226294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22281): Launched 20:05:54.339441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:05:54.590347 run patchelf(pid=22282): Launched 20:05:54.755473 run osmo-stp_10.42.42.5(pid=22279): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22279)] 20:05:54.881459 run osmo-stp_10.42.42.5(pid=22279): stdout: | (launched: 2022-12-12_20:05:53.548714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:55.008755 run osmo-stp_10.42.42.5(pid=22279): stderr: | 20221212200553716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200553716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200553717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200553717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200553718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200553718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200553718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:55.136564 run osmo-stp_10.42.42.5(pid=22279): stdout: | (launched: 2022-12-12_20:05:53.548714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:05:55.258166 run osmo-stp_10.42.42.5(pid=22279): stderr: | 20221212200553716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200553716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200553717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200553717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200553718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200553718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200553718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:05:55.402454 run patchelf(pid=22282): Terminating (SIGINT) 20:05:55.569624 run patchelf(pid=22282): Terminated: ok {rc=0} 20:05:55.691858 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22279): Process ended prematurely: osmo-stp_10.42.42.5(pid=22279) [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22279)] [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 20:05:55.701419 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:05:55.728807 run osmo-hlr_10.42.42.2(pid=22276): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22276)] 20:05:55.776257 run osmo-hlr_10.42.42.2(pid=22276): stdout: | (launched: 2022-12-12_20:05:52.487294) 20:05:55.825644 run osmo-hlr_10.42.42.2(pid=22276): stderr: | 20221212200552661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200552661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200552661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200552661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200552662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200552662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200552674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200552682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200552683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200552683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:05:55.875004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22265): Terminating (SIGTERM) 20:05:55.914568 run iperf3-srv_10.42.42.10(pid=22266): Terminating (SIGTERM) 20:05:55.954172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22267): Terminating (SIGTERM) 20:05:55.993796 run iperf3-srv_10.42.42.10(pid=22268): Terminating (SIGTERM) 20:05:56.033314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Terminating (SIGTERM) 20:05:56.073564 run iperf3-srv_10.42.42.10(pid=22270): Terminating (SIGTERM) 20:05:56.113137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22271): Terminating (SIGTERM) 20:05:56.152788 run iperf3-srv_10.42.42.10(pid=22272): Terminating (SIGTERM) 20:05:56.192235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22275): Terminating (SIGTERM) 20:05:56.231877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22278): Terminating (SIGTERM) 20:05:56.271495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22281): Terminating (SIGTERM) 20:05:56.311398 --- ParallelTerminationStrategy: PID 22265 died... 20:05:56.330322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22265): Terminated: ok {rc=0} 20:05:56.374339 --- ParallelTerminationStrategy: PID 22266 died... 20:05:56.393296 run iperf3-srv_10.42.42.10(pid=22266): Terminated {rc=256} 20:05:56.437474 --- ParallelTerminationStrategy: PID 22267 died... 20:05:56.456218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22267): Terminated: ok {rc=0} 20:05:56.500373 --- ParallelTerminationStrategy: PID 22268 died... 20:05:56.518993 run iperf3-srv_10.42.42.10(pid=22268): Terminated {rc=256} 20:05:56.563395 --- ParallelTerminationStrategy: PID 22269 died... 20:05:56.582209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22269): Terminated: ok {rc=0} 20:05:56.626087 --- ParallelTerminationStrategy: PID 22270 died... 20:05:56.644762 run iperf3-srv_10.42.42.10(pid=22270): Terminated {rc=256} 20:05:56.688557 --- ParallelTerminationStrategy: PID 22271 died... 20:05:56.707415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22271): Terminated: ok {rc=0} 20:05:56.751668 --- ParallelTerminationStrategy: PID 22272 died... 20:05:56.770597 run iperf3-srv_10.42.42.10(pid=22272): Terminated {rc=256} 20:05:56.814968 --- ParallelTerminationStrategy: PID 22275 died... 20:05:56.833688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22275): Terminated: ok {rc=0} 20:05:56.877858 --- ParallelTerminationStrategy: PID 22278 died... 20:05:56.896296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22278): Terminated: ok {rc=0} 20:05:56.940138 --- ParallelTerminationStrategy: PID 22281 died... 20:05:56.958675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22281): Terminated: ok {rc=0} 20:05:57.044231 bus /gobi_4: Setting Powered False 20:05:58.145161 bus /gobi_4: Setting Powered False 20:05:59.259542 bus /gobi_1: Setting Powered False 20:06:00.356591 bus /gobi_1: Setting Powered False 20:06:01.475189 bus /gobi_0: Setting Powered False 20:06:02.575529 bus /gobi_0: Setting Powered False 20:06:03.691812 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 20:06:04.795457 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:04.807041 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:06:04.852201 tst ping.py: using LAC 31189 20:06:04.968775 tst ping.py: using RAC 79 20:06:05.091661 tst ping.py: using CellId 31189 20:06:05.213602 tst ping.py: using BVCI 31190 20:06:05.328108 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:05.339440 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:05.350782 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:05.362432 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:05.373933 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:05.385561 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:05.397156 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:05.408422 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:06:05.522654 tst ping.py:19: start network... 20:06:05.715884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:06:06.165849 run create_hlr_db(pid=22283): Launched 20:06:06.285139 bus /gobi_6: Setting Powered False 20:06:07.343477 run create_hlr_db(pid=22283): Terminated: ok {rc=0} 20:06:07.750757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22285): Launched 20:06:08.042039 run osmo-hlr_10.42.42.2(pid=22286): Launched 20:06:08.152532 run osmo-stp_10.42.42.5: Starting osmo-stp 20:06:08.654487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22288): Launched 20:06:08.946392 run osmo-stp_10.42.42.5(pid=22289): Launched 20:06:09.057448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:06:09.558951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22291): Launched 20:06:09.670358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:06:09.917088 run patchelf(pid=22292): Launched 20:06:10.079412 run osmo-stp_10.42.42.5(pid=22289): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22289)] 20:06:10.202688 run osmo-stp_10.42.42.5(pid=22289): stdout: | (launched: 2022-12-12_20:06:08.891781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:10.328024 run osmo-stp_10.42.42.5(pid=22289): stderr: | 20221212200609059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200609059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200609059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200609060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200609060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200609060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200609060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:10.452682 run osmo-stp_10.42.42.5(pid=22289): stdout: | (launched: 2022-12-12_20:06:08.891781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:10.572536 run osmo-stp_10.42.42.5(pid=22289): stderr: | 20221212200609059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200609059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200609059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200609060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200609060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200609060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200609060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:10.714086 run patchelf(pid=22292): Terminating (SIGINT) 20:06:10.877584 run patchelf(pid=22292): Terminated: ok {rc=0} 20:06:10.995124 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22289): Process ended prematurely: osmo-stp_10.42.42.5(pid=22289) [trial-2381↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22289)] [trial-2381↪gprs:trx-lms-limenet-micro↪ping.py:22] 20:06:11.003901 tst ping.py:22: Test FAILED (6.2 sec) 20:06:11.030445 run osmo-hlr_10.42.42.2(pid=22286): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22286)] 20:06:11.078072 run osmo-hlr_10.42.42.2(pid=22286): stdout: | (launched: 2022-12-12_20:06:07.987673) 20:06:11.127159 run osmo-hlr_10.42.42.2(pid=22286): stderr: | 20221212200608160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200608160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200608161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200608161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200608161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200608161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200608176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200608186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200608186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200608186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:06:11.176747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22285): Terminating (SIGTERM) 20:06:11.216185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22288): Terminating (SIGTERM) 20:06:11.256547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22291): Terminating (SIGTERM) 20:06:11.296600 --- ParallelTerminationStrategy: PID 22285 died... 20:06:11.315580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22285): Terminated: ok {rc=0} 20:06:11.359182 --- ParallelTerminationStrategy: PID 22288 died... 20:06:11.377625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22288): Terminated: ok {rc=0} 20:06:11.421180 --- ParallelTerminationStrategy: PID 22291 died... 20:06:11.439672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22291): Terminated: ok {rc=0} 20:06:11.522572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 20:06:12.610012 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:12.622296 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:06:12.670724 tst ping_idle_ping.py: using LAC 31190 20:06:12.794601 tst ping_idle_ping.py: using RAC 80 20:06:12.916864 tst ping_idle_ping.py: using CellId 31190 20:06:13.040394 tst ping_idle_ping.py: using BVCI 31191 20:06:13.153953 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:13.165179 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:13.176194 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:13.187574 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:13.198787 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:13.210188 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:13.221603 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 20:06:13.232875 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 20:06:13.345962 tst ping_idle_ping.py:24: start network... 20:06:13.541298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:06:13.995227 run create_hlr_db(pid=22299): Launched 20:06:14.115556 bus /gobi_6: Setting Powered False 20:06:15.174440 run create_hlr_db(pid=22299): Terminated: ok {rc=0} 20:06:15.605533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22301): Launched 20:06:15.952196 run osmo-hlr_10.42.42.2(pid=22302): Launched 20:06:16.182524 run osmo-stp_10.42.42.5: Starting osmo-stp 20:06:17.023979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22304): Launched 20:06:17.385209 run osmo-stp_10.42.42.5(pid=22305): Launched 20:06:17.499837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:06:18.008473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22307): Launched 20:06:18.121056 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:06:18.369104 run patchelf(pid=22308): Launched 20:06:18.532130 run osmo-stp_10.42.42.5(pid=22305): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22305)] 20:06:18.657178 run osmo-stp_10.42.42.5(pid=22305): stdout: | (launched: 2022-12-12_20:06:17.324668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:18.782973 run osmo-stp_10.42.42.5(pid=22305): stderr: | 20221212200617505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200617505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200617506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200617506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200617507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200617507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200617507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:18.908866 run osmo-stp_10.42.42.5(pid=22305): stdout: | (launched: 2022-12-12_20:06:17.324668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:19.028506 run osmo-stp_10.42.42.5(pid=22305): stderr: | 20221212200617505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200617505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200617506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200617506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200617507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200617507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200617507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:19.170698 run patchelf(pid=22308): Terminating (SIGINT) 20:06:19.334726 run patchelf(pid=22308): Terminated: ok {rc=0} 20:06:19.453398 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22305): Process ended prematurely: osmo-stp_10.42.42.5(pid=22305) [trial-2381↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22305)] [trial-2381↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 20:06:19.462174 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:06:19.488701 run osmo-hlr_10.42.42.2(pid=22302): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22302)] 20:06:19.536380 run osmo-hlr_10.42.42.2(pid=22302): stdout: | (launched: 2022-12-12_20:06:15.874864) 20:06:19.585789 run osmo-hlr_10.42.42.2(pid=22302): stderr: | 20221212200616253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200616253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200616254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200616254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200616254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200616254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200616282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200616308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200616310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200616310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:06:19.635742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22301): Terminating (SIGTERM) 20:06:19.675371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22304): Terminating (SIGTERM) 20:06:19.714722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22307): Terminating (SIGTERM) 20:06:19.754344 --- ParallelTerminationStrategy: PID 22301 died... 20:06:19.773199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22301): Terminated: ok {rc=0} 20:06:19.817174 --- ParallelTerminationStrategy: PID 22304 died... 20:06:19.835503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22304): Terminated: ok {rc=0} 20:06:19.878927 --- ParallelTerminationStrategy: PID 22307 died... 20:06:19.897193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22307): Terminated: ok {rc=0} 20:06:19.982520 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 20:06:21.278328 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:06:21.283885 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:06:21.312730 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:06:21.350529 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:06:21.439172 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:06:21.470675 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:06:21.509809 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:06:22.097480 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:06:22.146984 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.157951 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:06:22.208574 tst cs_paging_gprs_active.py: using LAC 31191 20:06:22.327724 tst cs_paging_gprs_active.py: using RAC 81 20:06:22.442732 tst cs_paging_gprs_active.py: using CellId 31191 20:06:22.557988 tst cs_paging_gprs_active.py: using BVCI 31192 20:06:22.665429 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.677078 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.688004 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.698851 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.709629 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.720366 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.731342 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.742041 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:22.752869 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:06:22.871953 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:06:22.987060 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:06:23.187339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:06:23.487386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22312): Launched 20:06:23.749431 run iperf3-srv_10.42.42.10(pid=22313): Launched 20:06:23.861977 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:06:24.060490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:06:24.379869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22314): Launched 20:06:24.661226 run iperf3-srv_10.42.42.10(pid=22315): Launched 20:06:24.782036 tst cs_paging_gprs_active.py:38: start network... 20:06:24.997920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:06:25.493736 run create_hlr_db(pid=22316): Launched 20:06:25.616527 bus /gobi_6: Setting Powered False 20:06:26.680283 run create_hlr_db(pid=22316): Terminated: ok {rc=0} 20:06:27.111349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22318): Launched 20:06:27.410464 run osmo-hlr_10.42.42.2(pid=22319): Launched 20:06:27.524140 run osmo-stp_10.42.42.5: Starting osmo-stp 20:06:28.038668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22321): Launched 20:06:28.337908 run osmo-stp_10.42.42.5(pid=22322): Launched 20:06:28.451159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:06:28.968237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22324): Launched 20:06:29.083025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:06:29.335772 run patchelf(pid=22325): Launched 20:06:29.502429 run osmo-stp_10.42.42.5(pid=22322): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22322)] 20:06:29.628700 run osmo-stp_10.42.42.5(pid=22322): stdout: | (launched: 2022-12-12_20:06:28.281674) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:29.756609 run osmo-stp_10.42.42.5(pid=22322): stderr: | 20221212200628448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200628448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200628448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200628449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200628449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200628449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200628450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:29.884332 run osmo-stp_10.42.42.5(pid=22322): stdout: | (launched: 2022-12-12_20:06:28.281674) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:30.006179 run osmo-stp_10.42.42.5(pid=22322): stderr: | 20221212200628448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200628448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200628448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200628449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200628449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200628449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200628450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:30.150655 run patchelf(pid=22325): Terminating (SIGINT) 20:06:30.318070 run patchelf(pid=22325): Terminated: ok {rc=0} 20:06:30.438843 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22322): Process ended prematurely: osmo-stp_10.42.42.5(pid=22322) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22322)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:06:30.448248 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 20:06:30.475309 run osmo-hlr_10.42.42.2(pid=22319): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22319)] 20:06:30.522679 run osmo-hlr_10.42.42.2(pid=22319): stdout: | (launched: 2022-12-12_20:06:27.354749) 20:06:30.571818 run osmo-hlr_10.42.42.2(pid=22319): stderr: | 20221212200627529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200627529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200627529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200627529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200627529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200627529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200627542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200627553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200627553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200627553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:06:30.621431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22312): Terminating (SIGTERM) 20:06:30.660748 run iperf3-srv_10.42.42.10(pid=22313): Terminating (SIGTERM) 20:06:30.699922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22314): Terminating (SIGTERM) 20:06:30.739423 run iperf3-srv_10.42.42.10(pid=22315): Terminating (SIGTERM) 20:06:30.778810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22318): Terminating (SIGTERM) 20:06:30.818090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22321): Terminating (SIGTERM) 20:06:30.884730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22324): Terminating (SIGTERM) 20:06:30.941142 --- ParallelTerminationStrategy: PID 22312 died... 20:06:30.962013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22312): Terminated: ok {rc=0} 20:06:31.014487 --- ParallelTerminationStrategy: PID 22313 died... 20:06:31.035042 run iperf3-srv_10.42.42.10(pid=22313): Terminated {rc=256} 20:06:31.085811 --- ParallelTerminationStrategy: PID 22314 died... 20:06:31.106609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22314): Terminated: ok {rc=0} 20:06:31.156857 --- ParallelTerminationStrategy: PID 22315 died... 20:06:31.177406 run iperf3-srv_10.42.42.10(pid=22315): Terminated {rc=256} 20:06:31.227214 --- ParallelTerminationStrategy: PID 22318 died... 20:06:31.248161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22318): Terminated: ok {rc=0} 20:06:31.299173 --- ParallelTerminationStrategy: PID 22321 died... 20:06:31.319828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22321): Terminated: ok {rc=0} 20:06:31.370016 --- ParallelTerminationStrategy: PID 22324 died... 20:06:31.390663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22324): Terminated: ok {rc=0} 20:06:31.484825 bus /gobi_0: Setting Powered False 20:06:32.585270 bus /gobi_0: Setting Powered False 20:06:33.704508 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:06:34.849074 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:34.860515 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:06:34.906670 tst iperf3.py: using LAC 31192 20:06:35.022698 tst iperf3.py: using RAC 82 20:06:35.141875 tst iperf3.py: using CellId 31192 20:06:35.267552 tst iperf3.py: using BVCI 31193 20:06:35.384926 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.396654 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.408184 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.420528 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.432714 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.444883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.457470 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.469674 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:35.482242 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:06:35.598526 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:06:35.797086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:06:36.097230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22326): Launched 20:06:36.357688 run iperf3-srv_10.42.42.10(pid=22327): Launched 20:06:36.469304 tst iperf3.py:8: start network... 20:06:36.667395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:06:37.156106 run create_hlr_db(pid=22328): Launched 20:06:37.281380 bus /gobi_6: Setting Powered False 20:06:38.345093 run create_hlr_db(pid=22328): Terminated: ok {rc=0} 20:06:38.791031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22330): Launched 20:06:39.111935 run osmo-hlr_10.42.42.2(pid=22331): Launched 20:06:39.233535 run osmo-stp_10.42.42.5: Starting osmo-stp 20:06:39.779160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22333): Launched 20:06:40.099114 run osmo-stp_10.42.42.5(pid=22334): Launched 20:06:40.221723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:06:40.771587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22336): Launched 20:06:40.894668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:06:41.164376 run patchelf(pid=22337): Launched 20:06:41.342408 run osmo-stp_10.42.42.5(pid=22334): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22334)] 20:06:41.477116 run osmo-stp_10.42.42.5(pid=22334): stdout: | (launched: 2022-12-12_20:06:40.039864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:41.613911 run osmo-stp_10.42.42.5(pid=22334): stderr: | 20221212200640227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200640227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200640228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200640228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200640229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200640229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200640229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:41.751021 run osmo-stp_10.42.42.5(pid=22334): stdout: | (launched: 2022-12-12_20:06:40.039864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:41.882087 run osmo-stp_10.42.42.5(pid=22334): stderr: | 20221212200640227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200640227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200640228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200640228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200640229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200640229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200640229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:42.037187 run patchelf(pid=22337): Terminating (SIGINT) 20:06:42.215176 run patchelf(pid=22337): Terminated: ok {rc=0} 20:06:42.343834 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22334): Process ended prematurely: osmo-stp_10.42.42.5(pid=22334) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22334)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 20:06:42.353867 tst iperf3.py:8: Test FAILED (7.5 sec) 20:06:42.382870 run osmo-hlr_10.42.42.2(pid=22331): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22331)] 20:06:42.433177 run osmo-hlr_10.42.42.2(pid=22331): stdout: | (launched: 2022-12-12_20:06:39.052755) 20:06:42.485303 run osmo-hlr_10.42.42.2(pid=22331): stderr: | 20221212200639248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200639248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200639249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200639249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200639249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200639249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200639262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200639270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200639270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200639270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:06:42.537778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22326): Terminating (SIGTERM) 20:06:42.579476 run iperf3-srv_10.42.42.10(pid=22327): Terminating (SIGTERM) 20:06:42.621724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22330): Terminating (SIGTERM) 20:06:42.663846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22333): Terminating (SIGTERM) 20:06:42.705991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22336): Terminating (SIGTERM) 20:06:42.748360 --- ParallelTerminationStrategy: PID 22326 died... 20:06:42.768426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22326): Terminated: ok {rc=0} 20:06:42.815562 --- ParallelTerminationStrategy: PID 22327 died... 20:06:42.835508 run iperf3-srv_10.42.42.10(pid=22327): Terminated {rc=256} 20:06:42.882305 --- ParallelTerminationStrategy: PID 22330 died... 20:06:42.901860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22330): Terminated: ok {rc=0} 20:06:42.948502 --- ParallelTerminationStrategy: PID 22333 died... 20:06:42.968227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22333): Terminated: ok {rc=0} 20:06:43.014974 --- ParallelTerminationStrategy: PID 22336 died... 20:06:43.034625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22336): Terminated: ok {rc=0} 20:06:43.122364 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:06:44.272335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.284276 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:06:44.329088 tst iperf3m4.py: using LAC 31193 20:06:44.445301 tst iperf3m4.py: using RAC 83 20:06:44.560798 tst iperf3m4.py: using CellId 31193 20:06:44.677377 tst iperf3m4.py: using BVCI 31194 20:06:44.794162 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.806094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.817667 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.830019 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.842047 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.854007 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.866212 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.877970 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:06:44.889987 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:06:45.013386 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:06:45.131348 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:06:45.248792 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:06:45.370065 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:06:45.585478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:06:45.915698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Launched 20:06:46.226155 run iperf3-srv_10.42.42.10(pid=22339): Launched 20:06:46.361986 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:06:46.582113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:06:46.914539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Launched 20:06:47.205696 run iperf3-srv_10.42.42.10(pid=22341): Launched 20:06:47.326048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:06:47.540549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:06:47.861550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Launched 20:06:48.141809 run iperf3-srv_10.42.42.10(pid=22343): Launched 20:06:48.261881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:06:48.476553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:06:48.798541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Launched 20:06:49.078736 run iperf3-srv_10.42.42.10(pid=22345): Launched 20:06:49.199064 tst iperf3m4.py:8: start network... 20:06:49.413951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:06:49.909369 run create_hlr_db(pid=22346): Launched 20:06:50.031138 bus /gobi_6: Setting Powered False 20:06:51.094711 run create_hlr_db(pid=22346): Terminated: ok {rc=0} 20:06:51.522228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22349): Launched 20:06:51.821763 run osmo-hlr_10.42.42.2(pid=22350): Launched 20:06:51.935433 run osmo-stp_10.42.42.5: Starting osmo-stp 20:06:52.450062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22352): Launched 20:06:52.749607 run osmo-stp_10.42.42.5(pid=22353): Launched 20:06:52.862531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:06:53.376047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22355): Launched 20:06:53.490103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:06:53.742047 run patchelf(pid=22356): Launched 20:06:53.908828 run osmo-stp_10.42.42.5(pid=22353): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22353)] 20:06:54.035174 run osmo-stp_10.42.42.5(pid=22353): stdout: | (launched: 2022-12-12_20:06:52.693581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:54.163424 run osmo-stp_10.42.42.5(pid=22353): stderr: | 20221212200652861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200652862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200652862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200652862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200652863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200652863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200652863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:54.291431 run osmo-stp_10.42.42.5(pid=22353): stdout: | (launched: 2022-12-12_20:06:52.693581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:06:54.413140 run osmo-stp_10.42.42.5(pid=22353): stderr: | 20221212200652861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200652862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200652862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200652862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200652863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200652863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200652863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:06:54.557357 run patchelf(pid=22356): Terminating (SIGINT) 20:06:54.724259 run patchelf(pid=22356): Terminated: ok {rc=0} 20:06:54.844831 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22353): Process ended prematurely: osmo-stp_10.42.42.5(pid=22353) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22353)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 20:06:54.854422 tst iperf3m4.py:8: Test FAILED (10.6 sec) 20:06:54.881675 run osmo-hlr_10.42.42.2(pid=22350): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22350)] 20:06:54.929579 run osmo-hlr_10.42.42.2(pid=22350): stdout: | (launched: 2022-12-12_20:06:51.765883) 20:06:54.979552 run osmo-hlr_10.42.42.2(pid=22350): stderr: | 20221212200651940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200651940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200651940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200651941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200651941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200651941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200651960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200651970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200651970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200651970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:06:55.029306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Terminating (SIGTERM) 20:06:55.069050 run iperf3-srv_10.42.42.10(pid=22339): Terminating (SIGTERM) 20:06:55.108833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Terminating (SIGTERM) 20:06:55.148633 run iperf3-srv_10.42.42.10(pid=22341): Terminating (SIGTERM) 20:06:55.188333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Terminating (SIGTERM) 20:06:55.228050 run iperf3-srv_10.42.42.10(pid=22343): Terminating (SIGTERM) 20:06:55.267630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Terminating (SIGTERM) 20:06:55.307333 run iperf3-srv_10.42.42.10(pid=22345): Terminating (SIGTERM) 20:06:55.346638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22349): Terminating (SIGTERM) 20:06:55.386433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22352): Terminating (SIGTERM) 20:06:55.426089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22355): Terminating (SIGTERM) 20:06:55.465888 --- ParallelTerminationStrategy: PID 22338 died... 20:06:55.484920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Terminated: ok {rc=0} 20:06:55.528892 --- ParallelTerminationStrategy: PID 22339 died... 20:06:55.547732 run iperf3-srv_10.42.42.10(pid=22339): Terminated {rc=256} 20:06:55.591247 --- ParallelTerminationStrategy: PID 22340 died... 20:06:55.609918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22340): Terminated: ok {rc=0} 20:06:55.653535 --- ParallelTerminationStrategy: PID 22341 died... 20:06:55.672098 run iperf3-srv_10.42.42.10(pid=22341): Terminated {rc=256} 20:06:55.715686 --- ParallelTerminationStrategy: PID 22342 died... 20:06:55.734281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22342): Terminated: ok {rc=0} 20:06:55.778479 --- ParallelTerminationStrategy: PID 22343 died... 20:06:55.796912 run iperf3-srv_10.42.42.10(pid=22343): Terminated {rc=256} 20:06:55.840608 --- ParallelTerminationStrategy: PID 22344 died... 20:06:55.859225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22344): Terminated: ok {rc=0} 20:06:55.903206 --- ParallelTerminationStrategy: PID 22345 died... 20:06:55.921651 run iperf3-srv_10.42.42.10(pid=22345): Terminated {rc=256} 20:06:55.965127 --- ParallelTerminationStrategy: PID 22349 died... 20:06:55.983673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22349): Terminated: ok {rc=0} 20:06:56.027089 --- ParallelTerminationStrategy: PID 22352 died... 20:06:56.045687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22352): Terminated: ok {rc=0} 20:06:56.089085 --- ParallelTerminationStrategy: PID 22355 died... 20:06:56.107683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22355): Terminated: ok {rc=0} 20:06:56.192659 bus /gobi_4: Setting Powered False 20:06:57.295486 bus /gobi_4: Setting Powered False 20:06:58.413913 bus /gobi_1: Setting Powered False 20:06:59.512773 bus /gobi_1: Setting Powered False 20:07:00.628593 bus /gobi_0: Setting Powered False 20:07:01.731257 bus /gobi_0: Setting Powered False 20:07:02.851381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 20:07:03.956569 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:03.968554 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:07:04.015538 tst ping.py: using LAC 31194 20:07:04.129498 tst ping.py: using RAC 84 20:07:04.253683 tst ping.py: using CellId 31194 20:07:04.368329 tst ping.py: using BVCI 31195 20:07:04.473149 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:04.484037 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:04.494842 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:04.505669 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:04.516259 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:04.526900 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:04.537809 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:04.548560 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:07:04.661436 tst ping.py:19: start network... 20:07:04.855389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:05.307590 run create_hlr_db(pid=22357): Launched 20:07:05.427771 bus /gobi_6: Setting Powered False 20:07:06.486233 run create_hlr_db(pid=22357): Terminated: ok {rc=0} 20:07:06.915633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22359): Launched 20:07:07.229138 run osmo-hlr_10.42.42.2(pid=22360): Launched 20:07:07.349511 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:07.895828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22362): Launched 20:07:08.211320 run osmo-stp_10.42.42.5(pid=22363): Launched 20:07:08.331619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:07:08.877649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22365): Launched 20:07:08.996295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:07:09.245881 run patchelf(pid=22366): Launched 20:07:09.408278 run osmo-stp_10.42.42.5(pid=22363): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22363)] 20:07:09.532180 run osmo-stp_10.42.42.5(pid=22363): stdout: | (launched: 2022-12-12_20:07:08.152648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:09.657979 run osmo-stp_10.42.42.5(pid=22363): stderr: | 20221212200708340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200708340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200708340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200708340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200708341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200708341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200708341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:09.784032 run osmo-stp_10.42.42.5(pid=22363): stdout: | (launched: 2022-12-12_20:07:08.152648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:09.904133 run osmo-stp_10.42.42.5(pid=22363): stderr: | 20221212200708340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200708340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200708340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200708340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200708341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200708341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200708341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:10.046250 run patchelf(pid=22366): Terminating (SIGINT) 20:07:10.210137 run patchelf(pid=22366): Terminated: ok {rc=0} 20:07:10.328223 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22363): Process ended prematurely: osmo-stp_10.42.42.5(pid=22363) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22363)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 20:07:10.337141 tst ping.py:22: Test FAILED (6.4 sec) 20:07:10.363890 run osmo-hlr_10.42.42.2(pid=22360): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22360)] 20:07:10.411392 run osmo-hlr_10.42.42.2(pid=22360): stdout: | (launched: 2022-12-12_20:07:07.171236) 20:07:10.460833 run osmo-hlr_10.42.42.2(pid=22360): stderr: | 20221212200707368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200707369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200707369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200707369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200707369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200707369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200707382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200707390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200707390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200707391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:10.511074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22359): Terminating (SIGTERM) 20:07:10.550711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22362): Terminating (SIGTERM) 20:07:10.590407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22365): Terminating (SIGTERM) 20:07:10.630397 --- ParallelTerminationStrategy: PID 22359 died... 20:07:10.649555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22359): Terminated: ok {rc=0} 20:07:10.693482 --- ParallelTerminationStrategy: PID 22362 died... 20:07:10.712012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22362): Terminated: ok {rc=0} 20:07:10.756182 --- ParallelTerminationStrategy: PID 22365 died... 20:07:10.774889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22365): Terminated: ok {rc=0} 20:07:10.859619 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:07:11.948407 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:11.960044 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:07:12.008317 tst ping_idle_ping.py: using LAC 31195 20:07:12.125398 tst ping_idle_ping.py: using RAC 85 20:07:12.242297 tst ping_idle_ping.py: using CellId 31195 20:07:12.358877 tst ping_idle_ping.py: using BVCI 31196 20:07:12.467237 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:12.478282 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:12.489017 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:12.500283 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:12.511443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:12.522871 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:12.534227 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:07:12.545389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:07:12.663363 tst ping_idle_ping.py:24: start network... 20:07:12.875828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:13.366404 run create_hlr_db(pid=22367): Launched 20:07:13.486748 bus /gobi_6: Setting Powered False 20:07:14.549526 run create_hlr_db(pid=22367): Terminated: ok {rc=0} 20:07:14.991505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22369): Launched 20:07:15.307894 run osmo-hlr_10.42.42.2(pid=22370): Launched 20:07:15.428462 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:15.987423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22372): Launched 20:07:16.324208 run osmo-stp_10.42.42.5(pid=22373): Launched 20:07:16.528080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:07:17.194871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22375): Launched 20:07:17.329737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:07:17.599187 run patchelf(pid=22376): Launched 20:07:17.774872 run osmo-stp_10.42.42.5(pid=22373): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22373)] 20:07:17.908790 run osmo-stp_10.42.42.5(pid=22373): stdout: | (launched: 2022-12-12_20:07:16.257110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:18.044433 run osmo-stp_10.42.42.5(pid=22373): stderr: | 20221212200716540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200716540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200716540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200716543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200716544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200716544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200716544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:18.179771 run osmo-stp_10.42.42.5(pid=22373): stdout: | (launched: 2022-12-12_20:07:16.257110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:18.309044 run osmo-stp_10.42.42.5(pid=22373): stderr: | 20221212200716540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200716540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200716540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200716543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200716544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200716544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200716544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:18.462554 run patchelf(pid=22376): Terminating (SIGINT) 20:07:18.638286 run patchelf(pid=22376): Terminated: ok {rc=0} 20:07:18.764807 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22373): Process ended prematurely: osmo-stp_10.42.42.5(pid=22373) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22373)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 20:07:18.774586 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:07:18.803448 run osmo-hlr_10.42.42.2(pid=22370): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22370)] 20:07:18.854203 run osmo-hlr_10.42.42.2(pid=22370): stdout: | (launched: 2022-12-12_20:07:15.249824) 20:07:18.906555 run osmo-hlr_10.42.42.2(pid=22370): stderr: | 20221212200715443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200715443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200715443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200715443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200715443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200715443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200715455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200715464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200715464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200715464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:18.959389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22369): Terminating (SIGTERM) 20:07:19.001522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22372): Terminating (SIGTERM) 20:07:19.043626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22375): Terminating (SIGTERM) 20:07:19.086876 --- ParallelTerminationStrategy: PID 22369 died... 20:07:19.106718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22369): Terminated: ok {rc=0} 20:07:19.153785 --- ParallelTerminationStrategy: PID 22372 died... 20:07:19.173268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22372): Terminated: ok {rc=0} 20:07:19.219894 --- ParallelTerminationStrategy: PID 22375 died... 20:07:19.239362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22375): Terminated: ok {rc=0} 20:07:19.327590 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:07:20.625890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:20.631858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:07:20.660572 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:07:20.698868 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:07:20.785123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:07:20.813577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:07:20.851209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:07:21.446811 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:07:21.494782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:21.505812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:07:21.570323 tst cs_paging_gprs_active.py: using LAC 31196 20:07:21.686581 tst cs_paging_gprs_active.py: using RAC 86 20:07:21.804592 tst cs_paging_gprs_active.py: using CellId 31196 20:07:21.921192 tst cs_paging_gprs_active.py: using BVCI 31197 20:07:22.028532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.039566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.050361 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.061355 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.072095 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.082832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.093784 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.104538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:22.115445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:07:22.233419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:07:22.349680 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:07:22.549937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:07:22.851204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22380): Launched 20:07:23.114141 run iperf3-srv_10.42.42.10(pid=22381): Launched 20:07:23.227464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:07:23.426922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:07:23.727966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22382): Launched 20:07:23.990644 run iperf3-srv_10.42.42.10(pid=22383): Launched 20:07:24.102770 tst cs_paging_gprs_active.py:38: start network... 20:07:24.301852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:24.765172 run create_hlr_db(pid=22384): Launched 20:07:24.887491 bus /gobi_6: Setting Powered False 20:07:25.946962 run create_hlr_db(pid=22384): Terminated: ok {rc=0} 20:07:26.385997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22386): Launched 20:07:26.709687 run osmo-hlr_10.42.42.2(pid=22387): Launched 20:07:26.832791 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:27.386026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22389): Launched 20:07:27.708858 run osmo-stp_10.42.42.5(pid=22390): Launched 20:07:27.832667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:07:28.386584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22392): Launched 20:07:28.511077 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:07:28.783746 run patchelf(pid=22393): Launched 20:07:28.963376 run osmo-stp_10.42.42.5(pid=22390): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22390)] 20:07:29.100331 run osmo-stp_10.42.42.5(pid=22390): stdout: | (launched: 2022-12-12_20:07:27.649220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:29.239416 run osmo-stp_10.42.42.5(pid=22390): stderr: | 20221212200727839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200727839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200727840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200727840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200727840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200727841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200727841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:29.378079 run osmo-stp_10.42.42.5(pid=22390): stdout: | (launched: 2022-12-12_20:07:27.649220) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:29.509758 run osmo-stp_10.42.42.5(pid=22390): stderr: | 20221212200727839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200727839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200727840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200727840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200727840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200727841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200727841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:29.666069 run patchelf(pid=22393): Terminating (SIGINT) 20:07:29.847136 run patchelf(pid=22393): Terminated: ok {rc=0} 20:07:29.977512 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22390): Process ended prematurely: osmo-stp_10.42.42.5(pid=22390) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22390)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:07:29.987746 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:07:30.017040 run osmo-hlr_10.42.42.2(pid=22387): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22387)] 20:07:30.068510 run osmo-hlr_10.42.42.2(pid=22387): stdout: | (launched: 2022-12-12_20:07:26.650151) 20:07:30.121303 run osmo-hlr_10.42.42.2(pid=22387): stderr: | 20221212200726844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200726844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200726844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200726844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200726844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200726844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200726857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200726866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200726866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200726866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:30.175086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22380): Terminating (SIGTERM) 20:07:30.217621 run iperf3-srv_10.42.42.10(pid=22381): Terminating (SIGTERM) 20:07:30.260071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22382): Terminating (SIGTERM) 20:07:30.302682 run iperf3-srv_10.42.42.10(pid=22383): Terminating (SIGTERM) 20:07:30.345035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22386): Terminating (SIGTERM) 20:07:30.387425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22389): Terminating (SIGTERM) 20:07:30.429771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22392): Terminating (SIGTERM) 20:07:30.472220 --- ParallelTerminationStrategy: PID 22380 died... 20:07:30.492325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22380): Terminated: ok {rc=0} 20:07:30.540123 --- ParallelTerminationStrategy: PID 22381 died... 20:07:30.559821 run iperf3-srv_10.42.42.10(pid=22381): Terminated {rc=256} 20:07:30.607021 --- ParallelTerminationStrategy: PID 22382 died... 20:07:30.626701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22382): Terminated: ok {rc=0} 20:07:30.674100 --- ParallelTerminationStrategy: PID 22383 died... 20:07:30.693703 run iperf3-srv_10.42.42.10(pid=22383): Terminated {rc=256} 20:07:30.740468 --- ParallelTerminationStrategy: PID 22386 died... 20:07:30.759949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22386): Terminated: ok {rc=0} 20:07:30.806764 --- ParallelTerminationStrategy: PID 22389 died... 20:07:30.826508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22389): Terminated: ok {rc=0} 20:07:30.877237 --- ParallelTerminationStrategy: PID 22392 died... 20:07:30.897452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22392): Terminated: ok {rc=0} 20:07:30.998795 bus /gobi_0: Setting Powered False 20:07:32.122788 bus /gobi_0: Setting Powered False 20:07:33.243003 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:07:34.389507 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:34.401405 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:07:34.469485 tst iperf3.py: using LAC 31197 20:07:34.586193 tst iperf3.py: using RAC 87 20:07:34.702898 tst iperf3.py: using CellId 31197 20:07:34.819376 tst iperf3.py: using BVCI 31198 20:07:34.928391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:34.939447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:34.950368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:34.961221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:34.971888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:34.982845 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:34.993818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:35.004466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:35.015369 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:07:35.131479 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:07:35.331322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:07:35.631252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22394): Launched 20:07:35.892206 run iperf3-srv_10.42.42.10(pid=22395): Launched 20:07:36.004323 tst iperf3.py:8: start network... 20:07:36.202447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:36.663018 run create_hlr_db(pid=22396): Launched 20:07:36.785225 bus /gobi_6: Setting Powered False 20:07:37.845420 run create_hlr_db(pid=22396): Terminated: ok {rc=0} 20:07:38.262777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Launched 20:07:38.562304 run osmo-hlr_10.42.42.2(pid=22399): Launched 20:07:38.675718 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:39.213149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Launched 20:07:39.535981 run osmo-stp_10.42.42.5(pid=22402): Launched 20:07:39.660062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:07:40.213055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Launched 20:07:40.336998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:07:40.608921 run patchelf(pid=22405): Launched 20:07:40.788279 run osmo-stp_10.42.42.5(pid=22402): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] 20:07:40.925325 run osmo-stp_10.42.42.5(pid=22402): stdout: | (launched: 2022-12-12_20:07:39.476725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:41.063771 run osmo-stp_10.42.42.5(pid=22402): stderr: | 20221212200739666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200739666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200739666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200739667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200739667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200739667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200739667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:41.202577 run osmo-stp_10.42.42.5(pid=22402): stdout: | (launched: 2022-12-12_20:07:39.476725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:41.335166 run osmo-stp_10.42.42.5(pid=22402): stderr: | 20221212200739666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200739666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200739666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200739667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200739667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200739667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200739667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:41.490989 run patchelf(pid=22405): Terminating (SIGINT) 20:07:41.670880 run patchelf(pid=22405): Terminated: ok {rc=0} 20:07:41.801062 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22402): Process ended prematurely: osmo-stp_10.42.42.5(pid=22402) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 20:07:41.811293 tst iperf3.py:8: Test FAILED (7.5 sec) 20:07:41.840330 run osmo-hlr_10.42.42.2(pid=22399): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22399)] 20:07:41.891658 run osmo-hlr_10.42.42.2(pid=22399): stdout: | (launched: 2022-12-12_20:07:38.506143) 20:07:41.944239 run osmo-hlr_10.42.42.2(pid=22399): stderr: | 20221212200738681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200738681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200738681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200738681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200738682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200738682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200738694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200738703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200738703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200738703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:41.997367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22394): Terminating (SIGTERM) 20:07:42.039696 run iperf3-srv_10.42.42.10(pid=22395): Terminating (SIGTERM) 20:07:42.082277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Terminating (SIGTERM) 20:07:42.124779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Terminating (SIGTERM) 20:07:42.167194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Terminating (SIGTERM) 20:07:42.209761 --- ParallelTerminationStrategy: PID 22394 died... 20:07:42.229930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22394): Terminated: ok {rc=0} 20:07:42.277261 --- ParallelTerminationStrategy: PID 22395 died... 20:07:42.297061 run iperf3-srv_10.42.42.10(pid=22395): Terminated {rc=256} 20:07:42.344100 --- ParallelTerminationStrategy: PID 22398 died... 20:07:42.363946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Terminated: ok {rc=0} 20:07:42.411306 --- ParallelTerminationStrategy: PID 22401 died... 20:07:42.430973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Terminated: ok {rc=0} 20:07:42.477908 --- ParallelTerminationStrategy: PID 22404 died... 20:07:42.497488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Terminated: ok {rc=0} 20:07:42.585415 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:07:43.732183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:43.743780 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:07:43.809453 tst iperf3m4.py: using LAC 31198 20:07:43.927691 tst iperf3m4.py: using RAC 88 20:07:44.045306 tst iperf3m4.py: using CellId 31198 20:07:44.161527 tst iperf3m4.py: using BVCI 31199 20:07:44.268773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.279809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.290797 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.301647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.312396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.323191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.334111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.345242 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:07:44.356196 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:07:44.471467 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:07:44.591231 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:07:44.711575 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:07:44.827607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:07:45.027781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:07:45.329790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22406): Launched 20:07:45.592157 run iperf3-srv_10.42.42.10(pid=22407): Launched 20:07:45.704459 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:07:45.910603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:07:46.263395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22408): Launched 20:07:46.545828 run iperf3-srv_10.42.42.10(pid=22409): Launched 20:07:46.670855 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:07:46.873480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:07:47.184264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22410): Launched 20:07:47.472367 run iperf3-srv_10.42.42.10(pid=22411): Launched 20:07:47.585925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:07:47.785379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:07:48.086304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22412): Launched 20:07:48.348929 run iperf3-srv_10.42.42.10(pid=22413): Launched 20:07:48.461426 tst iperf3m4.py:8: start network... 20:07:48.660371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:49.122633 run create_hlr_db(pid=22414): Launched 20:07:49.245558 bus /gobi_6: Setting Powered False 20:07:50.305626 run create_hlr_db(pid=22414): Terminated: ok {rc=0} 20:07:50.745521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22416): Launched 20:07:51.068229 run osmo-hlr_10.42.42.2(pid=22417): Launched 20:07:51.190647 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:51.745558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22419): Launched 20:07:52.067684 run osmo-stp_10.42.42.5(pid=22420): Launched 20:07:52.189847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:07:52.743195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22422): Launched 20:07:52.866695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:07:53.137788 run patchelf(pid=22423): Launched 20:07:53.316508 run osmo-stp_10.42.42.5(pid=22420): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22420)] 20:07:53.453388 run osmo-stp_10.42.42.5(pid=22420): stdout: | (launched: 2022-12-12_20:07:52.008254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:53.591341 run osmo-stp_10.42.42.5(pid=22420): stderr: | 20221212200752195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200752196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200752196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200752196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200752197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200752197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200752197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:53.729190 run osmo-stp_10.42.42.5(pid=22420): stdout: | (launched: 2022-12-12_20:07:52.008254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:53.860773 run osmo-stp_10.42.42.5(pid=22420): stderr: | 20221212200752195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200752196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200752196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200752196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200752197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200752197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200752197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:54.016814 run patchelf(pid=22423): Terminating (SIGINT) 20:07:54.196486 run patchelf(pid=22423): Terminated: ok {rc=0} 20:07:54.326778 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22420): Process ended prematurely: osmo-stp_10.42.42.5(pid=22420) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22420)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:07:54.337048 tst iperf3m4.py:8: Test FAILED (10.6 sec) 20:07:54.366774 run osmo-hlr_10.42.42.2(pid=22417): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22417)] 20:07:54.417275 run osmo-hlr_10.42.42.2(pid=22417): stdout: | (launched: 2022-12-12_20:07:51.008534) 20:07:54.469594 run osmo-hlr_10.42.42.2(pid=22417): stderr: | 20221212200751203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200751203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200751203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200751203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200751203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200751203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200751215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200751224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200751224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200751224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:54.522356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22406): Terminating (SIGTERM) 20:07:54.564473 run iperf3-srv_10.42.42.10(pid=22407): Terminating (SIGTERM) 20:07:54.606663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22408): Terminating (SIGTERM) 20:07:54.648607 run iperf3-srv_10.42.42.10(pid=22409): Terminating (SIGTERM) 20:07:54.690472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22410): Terminating (SIGTERM) 20:07:54.732303 run iperf3-srv_10.42.42.10(pid=22411): Terminating (SIGTERM) 20:07:54.774060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22412): Terminating (SIGTERM) 20:07:54.815857 run iperf3-srv_10.42.42.10(pid=22413): Terminating (SIGTERM) 20:07:54.857998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22416): Terminating (SIGTERM) 20:07:54.899947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22419): Terminating (SIGTERM) 20:07:54.941892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22422): Terminating (SIGTERM) 20:07:54.983908 --- ParallelTerminationStrategy: PID 22406 died... 20:07:55.003830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22406): Terminated: ok {rc=0} 20:07:55.050754 --- ParallelTerminationStrategy: PID 22407 died... 20:07:55.070320 run iperf3-srv_10.42.42.10(pid=22407): Terminated {rc=256} 20:07:55.116880 --- ParallelTerminationStrategy: PID 22408 died... 20:07:55.136745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22408): Terminated: ok {rc=0} 20:07:55.183379 --- ParallelTerminationStrategy: PID 22409 died... 20:07:55.202727 run iperf3-srv_10.42.42.10(pid=22409): Terminated {rc=256} 20:07:55.249167 --- ParallelTerminationStrategy: PID 22410 died... 20:07:55.268549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22410): Terminated: ok {rc=0} 20:07:55.315089 --- ParallelTerminationStrategy: PID 22411 died... 20:07:55.334486 run iperf3-srv_10.42.42.10(pid=22411): Terminated {rc=256} 20:07:55.381193 --- ParallelTerminationStrategy: PID 22412 died... 20:07:55.400515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22412): Terminated: ok {rc=0} 20:07:55.447485 --- ParallelTerminationStrategy: PID 22413 died... 20:07:55.466906 run iperf3-srv_10.42.42.10(pid=22413): Terminated {rc=256} 20:07:55.513371 --- ParallelTerminationStrategy: PID 22416 died... 20:07:55.532875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22416): Terminated: ok {rc=0} 20:07:55.579515 --- ParallelTerminationStrategy: PID 22419 died... 20:07:55.599040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22419): Terminated: ok {rc=0} 20:07:55.645672 --- ParallelTerminationStrategy: PID 22422 died... 20:07:55.665241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22422): Terminated: ok {rc=0} 20:07:55.754081 bus /gobi_4: Setting Powered False 20:07:56.853941 bus /gobi_4: Setting Powered False 20:07:57.970831 bus /gobi_1: Setting Powered False 20:07:59.069636 bus /gobi_1: Setting Powered False 20:08:00.185234 bus /gobi_0: Setting Powered False 20:08:01.282088 bus /gobi_0: Setting Powered False 20:08:02.396765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:08:03.499095 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:03.511525 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:08:03.580038 tst ping.py: using LAC 31199 20:08:03.707648 tst ping.py: using RAC 89 20:08:03.838770 tst ping.py: using CellId 31199 20:08:03.962372 tst ping.py: using BVCI 31200 20:08:04.075998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:04.087960 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:04.099582 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:04.111499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:04.123119 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:04.134955 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:04.146550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:04.158767 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:08:04.274693 tst ping.py:19: start network... 20:08:04.471030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:04.926447 run create_hlr_db(pid=22424): Launched 20:08:05.046611 bus /gobi_6: Setting Powered False 20:08:06.105267 run create_hlr_db(pid=22424): Terminated: ok {rc=0} 20:08:06.537383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22426): Launched 20:08:06.852787 run osmo-hlr_10.42.42.2(pid=22427): Launched 20:08:06.973905 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:07.523289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22429): Launched 20:08:07.839321 run osmo-stp_10.42.42.5(pid=22430): Launched 20:08:07.959993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:08:08.505228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22432): Launched 20:08:08.625878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:08:08.893934 run patchelf(pid=22433): Launched 20:08:09.069885 run osmo-stp_10.42.42.5(pid=22430): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22430)] 20:08:09.203507 run osmo-stp_10.42.42.5(pid=22430): stdout: | (launched: 2022-12-12_20:08:07.780753) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:09.338706 run osmo-stp_10.42.42.5(pid=22430): stderr: | 20221212200807969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200807969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200807969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200807970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200807970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200807970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200807970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:09.473939 run osmo-stp_10.42.42.5(pid=22430): stdout: | (launched: 2022-12-12_20:08:07.780753) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:09.604006 run osmo-stp_10.42.42.5(pid=22430): stderr: | 20221212200807969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200807969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200807969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200807970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200807970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200807970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200807970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:09.757770 run patchelf(pid=22433): Terminating (SIGINT) 20:08:09.934232 run patchelf(pid=22433): Terminated: ok {rc=0} 20:08:10.060880 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22430): Process ended prematurely: osmo-stp_10.42.42.5(pid=22430) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22430)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 20:08:10.070625 tst ping.py:22: Test FAILED (6.6 sec) 20:08:10.099386 run osmo-hlr_10.42.42.2(pid=22427): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22427)] 20:08:10.150858 run osmo-hlr_10.42.42.2(pid=22427): stdout: | (launched: 2022-12-12_20:08:06.794424) 20:08:10.203565 run osmo-hlr_10.42.42.2(pid=22427): stderr: | 20221212200806990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200806990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200806990 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200806990 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200806990 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200806990 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200807002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200807010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200807010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200807010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:10.256623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22426): Terminating (SIGTERM) 20:08:10.299170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22429): Terminating (SIGTERM) 20:08:10.341665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22432): Terminating (SIGTERM) 20:08:10.384328 --- ParallelTerminationStrategy: PID 22426 died... 20:08:10.404639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22426): Terminated: ok {rc=0} 20:08:10.453103 --- ParallelTerminationStrategy: PID 22429 died... 20:08:10.472620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22429): Terminated: ok {rc=0} 20:08:10.519490 --- ParallelTerminationStrategy: PID 22432 died... 20:08:10.539099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22432): Terminated: ok {rc=0} 20:08:10.627627 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:08:11.716437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:11.728933 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:08:11.797721 tst ping_idle_ping.py: using LAC 31200 20:08:11.922808 tst ping_idle_ping.py: using RAC 90 20:08:12.045399 tst ping_idle_ping.py: using CellId 31200 20:08:12.168044 tst ping_idle_ping.py: using BVCI 31201 20:08:12.281773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:12.293270 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:12.304538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:12.316135 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:12.327732 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:12.339426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:12.351066 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:08:12.362630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:08:12.478780 tst ping_idle_ping.py:24: start network... 20:08:12.677331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:13.136132 run create_hlr_db(pid=22435): Launched 20:08:13.257415 bus /gobi_6: Setting Powered False 20:08:14.317227 run create_hlr_db(pid=22435): Terminated: ok {rc=0} 20:08:14.729149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22437): Launched 20:08:15.024419 run osmo-hlr_10.42.42.2(pid=22438): Launched 20:08:15.137247 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:15.657520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22440): Launched 20:08:15.993709 run osmo-stp_10.42.42.5(pid=22441): Launched 20:08:16.136092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:08:16.808999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22443): Launched 20:08:16.941835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:08:17.216701 run patchelf(pid=22444): Launched 20:08:17.397248 run osmo-stp_10.42.42.5(pid=22441): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22441)] 20:08:17.531586 run osmo-stp_10.42.42.5(pid=22441): stdout: | (launched: 2022-12-12_20:08:15.923845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:17.667721 run osmo-stp_10.42.42.5(pid=22441): stderr: | 20221212200816244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200816244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200816253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200816254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200816254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200816254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200816254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:17.803764 run osmo-stp_10.42.42.5(pid=22441): stdout: | (launched: 2022-12-12_20:08:15.923845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:17.934814 run osmo-stp_10.42.42.5(pid=22441): stderr: | 20221212200816244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200816244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200816253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200816254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200816254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200816254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200816254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:18.088458 run patchelf(pid=22444): Terminating (SIGINT) 20:08:18.265556 run patchelf(pid=22444): Terminated: ok {rc=0} 20:08:18.393124 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22441): Process ended prematurely: osmo-stp_10.42.42.5(pid=22441) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22441)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:08:18.402866 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:08:18.431910 run osmo-hlr_10.42.42.2(pid=22438): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22438)] 20:08:18.483352 run osmo-hlr_10.42.42.2(pid=22438): stdout: | (launched: 2022-12-12_20:08:14.969357) 20:08:18.535880 run osmo-hlr_10.42.42.2(pid=22438): stderr: | 20221212200815144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200815144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200815144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200815144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200815144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200815144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200815156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200815165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200815166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200815166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:18.589053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22437): Terminating (SIGTERM) 20:08:18.631457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22440): Terminating (SIGTERM) 20:08:18.673998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22443): Terminating (SIGTERM) 20:08:18.716648 --- ParallelTerminationStrategy: PID 22437 died... 20:08:18.737011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22437): Terminated: ok {rc=0} 20:08:18.784374 --- ParallelTerminationStrategy: PID 22440 died... 20:08:18.804283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22440): Terminated: ok {rc=0} 20:08:18.851137 --- ParallelTerminationStrategy: PID 22443 died... 20:08:18.871250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22443): Terminated: ok {rc=0} 20:08:18.959549 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:08:20.262186 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:08:20.268792 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:08:20.299505 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:08:20.338933 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:08:20.425182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:08:20.455093 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:08:20.494503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:08:21.094062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:08:21.145934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.157518 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:08:21.223387 tst cs_paging_gprs_active.py: using LAC 31201 20:08:21.346647 tst cs_paging_gprs_active.py: using RAC 91 20:08:21.470097 tst cs_paging_gprs_active.py: using CellId 31201 20:08:21.593623 tst cs_paging_gprs_active.py: using BVCI 31202 20:08:21.709853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.721523 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.732810 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.744488 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.756165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.767657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.779305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.790760 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:21.802535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:08:21.919881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:08:22.037273 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:08:22.237332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:08:22.541739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22448): Launched 20:08:22.823354 run iperf3-srv_10.42.42.10(pid=22449): Launched 20:08:22.946754 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:08:23.162797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:08:23.486123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22450): Launched 20:08:23.767559 run iperf3-srv_10.42.42.10(pid=22451): Launched 20:08:23.888584 tst cs_paging_gprs_active.py:38: start network... 20:08:24.105348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:24.602670 run create_hlr_db(pid=22452): Launched 20:08:24.724756 bus /gobi_6: Setting Powered False 20:08:25.788494 run create_hlr_db(pid=22452): Terminated: ok {rc=0} 20:08:26.236007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Launched 20:08:26.558458 run osmo-hlr_10.42.42.2(pid=22455): Launched 20:08:26.681055 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:27.235452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Launched 20:08:27.557867 run osmo-stp_10.42.42.5(pid=22458): Launched 20:08:27.682238 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:08:28.238089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22460): Launched 20:08:28.361686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:08:28.640663 run patchelf(pid=22461): Launched 20:08:28.819835 run osmo-stp_10.42.42.5(pid=22458): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] 20:08:28.956880 run osmo-stp_10.42.42.5(pid=22458): stdout: | (launched: 2022-12-12_20:08:27.498399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:29.095041 run osmo-stp_10.42.42.5(pid=22458): stderr: | 20221212200827689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200827689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200827689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200827690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200827690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200827690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200827690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:29.233739 run osmo-stp_10.42.42.5(pid=22458): stdout: | (launched: 2022-12-12_20:08:27.498399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:29.365493 run osmo-stp_10.42.42.5(pid=22458): stderr: | 20221212200827689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200827689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200827689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200827690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200827690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200827690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200827690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:29.521885 run patchelf(pid=22461): Terminating (SIGINT) 20:08:29.702687 run patchelf(pid=22461): Terminated: ok {rc=0} 20:08:29.833115 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22458): Process ended prematurely: osmo-stp_10.42.42.5(pid=22458) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:08:29.843336 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:08:29.872835 run osmo-hlr_10.42.42.2(pid=22455): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22455)] 20:08:29.923611 run osmo-hlr_10.42.42.2(pid=22455): stdout: | (launched: 2022-12-12_20:08:26.498724) 20:08:29.975782 run osmo-hlr_10.42.42.2(pid=22455): stderr: | 20221212200826696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200826697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200826697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200826697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200826697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200826697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200826712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200826722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200826722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200826722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:30.028493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22448): Terminating (SIGTERM) 20:08:30.070683 run iperf3-srv_10.42.42.10(pid=22449): Terminating (SIGTERM) 20:08:30.112939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22450): Terminating (SIGTERM) 20:08:30.155335 run iperf3-srv_10.42.42.10(pid=22451): Terminating (SIGTERM) 20:08:30.197556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Terminating (SIGTERM) 20:08:30.240151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Terminating (SIGTERM) 20:08:30.282462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22460): Terminating (SIGTERM) 20:08:30.324886 --- ParallelTerminationStrategy: PID 22448 died... 20:08:30.345062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22448): Terminated: ok {rc=0} 20:08:30.392174 --- ParallelTerminationStrategy: PID 22449 died... 20:08:30.411672 run iperf3-srv_10.42.42.10(pid=22449): Terminated {rc=256} 20:08:30.458337 --- ParallelTerminationStrategy: PID 22450 died... 20:08:30.478017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22450): Terminated: ok {rc=0} 20:08:30.524658 --- ParallelTerminationStrategy: PID 22451 died... 20:08:30.544383 run iperf3-srv_10.42.42.10(pid=22451): Terminated {rc=256} 20:08:30.591100 --- ParallelTerminationStrategy: PID 22454 died... 20:08:30.610915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Terminated: ok {rc=0} 20:08:30.657697 --- ParallelTerminationStrategy: PID 22457 died... 20:08:30.677549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Terminated: ok {rc=0} 20:08:30.724075 --- ParallelTerminationStrategy: PID 22460 died... 20:08:30.743850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22460): Terminated: ok {rc=0} 20:08:30.834024 bus /gobi_0: Setting Powered False 20:08:31.959459 bus /gobi_0: Setting Powered False 20:08:33.085537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:08:34.233552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.245714 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:08:34.319820 tst iperf3.py: using LAC 31202 20:08:34.445999 tst iperf3.py: using RAC 92 20:08:34.569656 tst iperf3.py: using CellId 31202 20:08:34.693399 tst iperf3.py: using BVCI 31203 20:08:34.809792 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.821466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.832726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.844492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.856181 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.867793 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.879936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.891559 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:34.903422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:08:35.020402 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:08:35.222112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:08:35.523142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22462): Launched 20:08:35.786102 run iperf3-srv_10.42.42.10(pid=22463): Launched 20:08:35.898418 tst iperf3.py:8: start network... 20:08:36.097353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:36.561106 run create_hlr_db(pid=22464): Launched 20:08:36.684441 bus /gobi_6: Setting Powered False 20:08:37.745165 run create_hlr_db(pid=22464): Terminated: ok {rc=0} 20:08:38.165027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Launched 20:08:38.465672 run osmo-hlr_10.42.42.2(pid=22467): Launched 20:08:38.579803 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:39.112074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Launched 20:08:39.413526 run osmo-stp_10.42.42.5(pid=22470): Launched 20:08:39.529247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:08:40.046805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Launched 20:08:40.161667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:08:40.414967 run patchelf(pid=22473): Launched 20:08:40.582052 run osmo-stp_10.42.42.5(pid=22470): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] 20:08:40.708847 run osmo-stp_10.42.42.5(pid=22470): stdout: | (launched: 2022-12-12_20:08:39.357521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:40.837688 run osmo-stp_10.42.42.5(pid=22470): stderr: | 20221212200839525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200839525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200839525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200839525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200839526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200839526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200839526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:40.966738 run osmo-stp_10.42.42.5(pid=22470): stdout: | (launched: 2022-12-12_20:08:39.357521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:41.089505 run osmo-stp_10.42.42.5(pid=22470): stderr: | 20221212200839525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200839525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200839525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200839525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200839526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200839526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200839526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:41.234920 run patchelf(pid=22473): Terminating (SIGINT) 20:08:41.403270 run patchelf(pid=22473): Terminated: ok {rc=0} 20:08:41.524534 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22470): Process ended prematurely: osmo-stp_10.42.42.5(pid=22470) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 20:08:41.534297 tst iperf3.py:8: Test FAILED (7.3 sec) 20:08:41.561447 run osmo-hlr_10.42.42.2(pid=22467): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22467)] 20:08:41.608822 run osmo-hlr_10.42.42.2(pid=22467): stdout: | (launched: 2022-12-12_20:08:38.409871) 20:08:41.658348 run osmo-hlr_10.42.42.2(pid=22467): stderr: | 20221212200838582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200838582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200838582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200838582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200838582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200838582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200838594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200838604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200838604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200838604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:41.708013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22462): Terminating (SIGTERM) 20:08:41.747485 run iperf3-srv_10.42.42.10(pid=22463): Terminating (SIGTERM) 20:08:41.787661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Terminating (SIGTERM) 20:08:41.827442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Terminating (SIGTERM) 20:08:41.866999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Terminating (SIGTERM) 20:08:41.907053 --- ParallelTerminationStrategy: PID 22462 died... 20:08:41.926081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22462): Terminated: ok {rc=0} 20:08:41.970674 --- ParallelTerminationStrategy: PID 22463 died... 20:08:41.989173 run iperf3-srv_10.42.42.10(pid=22463): Terminated {rc=256} 20:08:42.032714 --- ParallelTerminationStrategy: PID 22466 died... 20:08:42.051398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Terminated: ok {rc=0} 20:08:42.095117 --- ParallelTerminationStrategy: PID 22469 died... 20:08:42.113680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Terminated: ok {rc=0} 20:08:42.157229 --- ParallelTerminationStrategy: PID 22472 died... 20:08:42.175737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Terminated: ok {rc=0} 20:08:42.259684 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:08:43.409647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:43.422011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:08:43.491696 tst iperf3m4.py: using LAC 31203 20:08:43.622757 tst iperf3m4.py: using RAC 93 20:08:43.747717 tst iperf3m4.py: using CellId 31203 20:08:43.872529 tst iperf3m4.py: using BVCI 31204 20:08:43.989123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.000588 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.011963 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.023754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.035617 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.047354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.059221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.070923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:08:44.083048 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:08:44.202878 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:08:44.320856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:08:44.439756 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:08:44.556861 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:08:44.758787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:08:45.059353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22474): Launched 20:08:45.322406 run iperf3-srv_10.42.42.10(pid=22475): Launched 20:08:45.434401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:08:45.633103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:08:45.955365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22476): Launched 20:08:46.309996 run iperf3-srv_10.42.42.10(pid=22487): Launched 20:08:46.502815 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:08:46.743153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:08:47.067647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22521): Launched 20:08:47.374643 run iperf3-srv_10.42.42.10(pid=22528): Launched 20:08:47.508054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:08:47.749374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:08:48.097861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22558): Launched 20:08:48.420693 run iperf3-srv_10.42.42.10(pid=22577): Launched 20:08:48.580830 tst iperf3m4.py:8: start network... 20:08:48.814286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:49.395062 run create_hlr_db(pid=22699): Launched 20:08:49.601439 bus /gobi_6: Setting Powered False 20:08:50.666825 run create_hlr_db(pid=22699): Terminated: ok {rc=0} 20:08:51.151405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22753): Launched 20:08:51.497314 run osmo-hlr_10.42.42.2(pid=22754): Launched 20:08:51.746894 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:52.418136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22758): Launched 20:08:52.764539 run osmo-stp_10.42.42.5(pid=22759): Launched 20:08:53.017541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:08:53.667868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22761): Launched 20:08:53.806879 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:08:54.093851 run patchelf(pid=22762): Launched 20:08:54.293631 run osmo-stp_10.42.42.5(pid=22759): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22759)] 20:08:54.436526 run osmo-stp_10.42.42.5(pid=22759): stdout: | (launched: 2022-12-12_20:08:52.701948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:54.582790 run osmo-stp_10.42.42.5(pid=22759): stderr: | 20221212200852996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200852996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200852996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200852996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200852997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200852997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200852997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:54.730176 run osmo-stp_10.42.42.5(pid=22759): stdout: | (launched: 2022-12-12_20:08:52.701948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:54.870201 run osmo-stp_10.42.42.5(pid=22759): stderr: | 20221212200852996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200852996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200852996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200852996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200852997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200852997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200852997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:55.036363 run patchelf(pid=22762): Terminating (SIGINT) 20:08:55.226575 run patchelf(pid=22762): Terminated: ok {rc=0} 20:08:55.365139 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22759): Process ended prematurely: osmo-stp_10.42.42.5(pid=22759) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22759)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:08:55.376222 tst iperf3m4.py:8: Test FAILED (12.0 sec) 20:08:55.409225 run osmo-hlr_10.42.42.2(pid=22754): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22754)] 20:08:55.463023 run osmo-hlr_10.42.42.2(pid=22754): stdout: | (launched: 2022-12-12_20:08:51.433554) 20:08:55.519100 run osmo-hlr_10.42.42.2(pid=22754): stderr: | 20221212200851734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200851734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200851734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200851734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200851734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200851734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200851758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200851767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200851767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200851767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:55.575764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22474): Terminating (SIGTERM) 20:08:55.621289 run iperf3-srv_10.42.42.10(pid=22475): Terminating (SIGTERM) 20:08:55.670184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22476): Terminating (SIGTERM) 20:08:55.718555 run iperf3-srv_10.42.42.10(pid=22487): Terminating (SIGTERM) 20:08:55.766638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22521): Terminating (SIGTERM) 20:08:55.812119 run iperf3-srv_10.42.42.10(pid=22528): Terminating (SIGTERM) 20:08:55.859158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22558): Terminating (SIGTERM) 20:08:55.906097 run iperf3-srv_10.42.42.10(pid=22577): Terminating (SIGTERM) 20:08:55.953675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22753): Terminating (SIGTERM) 20:08:55.998900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22758): Terminating (SIGTERM) 20:08:56.046405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22761): Terminating (SIGTERM) 20:08:56.094799 --- ParallelTerminationStrategy: PID 22474 died... 20:08:56.115936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22474): Terminated: ok {rc=0} 20:08:56.168104 --- ParallelTerminationStrategy: PID 22475 died... 20:08:56.189406 run iperf3-srv_10.42.42.10(pid=22475): Terminated {rc=256} 20:08:56.240005 --- ParallelTerminationStrategy: PID 22476 died... 20:08:56.261202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22476): Terminated: ok {rc=0} 20:08:56.312753 --- ParallelTerminationStrategy: PID 22487 died... 20:08:56.333777 run iperf3-srv_10.42.42.10(pid=22487): Terminated {rc=256} 20:08:56.384379 --- ParallelTerminationStrategy: PID 22521 died... 20:08:56.405519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22521): Terminated: ok {rc=0} 20:08:56.457116 --- ParallelTerminationStrategy: PID 22528 died... 20:08:56.478936 run iperf3-srv_10.42.42.10(pid=22528): Terminated {rc=256} 20:08:56.529552 --- ParallelTerminationStrategy: PID 22558 died... 20:08:56.550781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22558): Terminated: ok {rc=0} 20:08:56.601892 --- ParallelTerminationStrategy: PID 22577 died... 20:08:56.623352 run iperf3-srv_10.42.42.10(pid=22577): Terminated {rc=256} 20:08:56.675220 --- ParallelTerminationStrategy: PID 22753 died... 20:08:56.698443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22753): Terminated: ok {rc=0} 20:08:56.749362 --- ParallelTerminationStrategy: PID 22758 died... 20:08:56.770427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22758): Terminated: ok {rc=0} 20:08:56.821489 --- ParallelTerminationStrategy: PID 22761 died... 20:08:56.842867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22761): Terminated: ok {rc=0} 20:08:56.938865 bus /gobi_4: Setting Powered False 20:08:58.043515 bus /gobi_4: Setting Powered False 20:08:59.166981 bus /gobi_1: Setting Powered False 20:09:00.273869 bus /gobi_1: Setting Powered False 20:09:01.415670 bus /gobi_0: Setting Powered False 20:09:02.529588 bus /gobi_0: Setting Powered False 20:09:03.655711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:09:04.770305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:04.784289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:09:04.858328 tst ping.py: using LAC 31204 20:09:04.989830 tst ping.py: using RAC 94 20:09:05.124272 tst ping.py: using CellId 31204 20:09:05.254786 tst ping.py: using BVCI 31205 20:09:05.378670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:05.391848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:05.404462 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:05.418946 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:05.433055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:05.446781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:05.459968 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:05.474674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:09:05.599841 tst ping.py:19: start network... 20:09:05.826788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:06.345365 run create_hlr_db(pid=22763): Launched 20:09:06.513060 bus /gobi_6: Setting Powered False 20:09:07.579700 run create_hlr_db(pid=22763): Terminated: ok {rc=0} 20:09:08.046969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22765): Launched 20:09:08.392750 run osmo-hlr_10.42.42.2(pid=22766): Launched 20:09:08.642004 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:09.333712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22768): Launched 20:09:09.645575 run osmo-stp_10.42.42.5(pid=22769): Launched 20:09:09.761589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:09:10.282913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22771): Launched 20:09:10.399915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:09:10.655577 run patchelf(pid=22772): Launched 20:09:10.824879 run osmo-stp_10.42.42.5(pid=22769): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22769)] 20:09:10.951888 run osmo-stp_10.42.42.5(pid=22769): stdout: | (launched: 2022-12-12_20:09:09.588836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:11.080658 run osmo-stp_10.42.42.5(pid=22769): stderr: | 20221212200909763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200909763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200909763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200909764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200909764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200909764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200909764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:11.209629 run osmo-stp_10.42.42.5(pid=22769): stdout: | (launched: 2022-12-12_20:09:09.588836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:11.332463 run osmo-stp_10.42.42.5(pid=22769): stderr: | 20221212200909763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200909763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200909763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200909764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200909764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200909764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200909764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:11.478629 run patchelf(pid=22772): Terminating (SIGINT) 20:09:11.646671 run patchelf(pid=22772): Terminated: ok {rc=0} 20:09:11.767578 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22769): Process ended prematurely: osmo-stp_10.42.42.5(pid=22769) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22769)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 20:09:11.776579 tst ping.py:22: Test FAILED (7.0 sec) 20:09:11.803668 run osmo-hlr_10.42.42.2(pid=22766): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22766)] 20:09:11.851611 run osmo-hlr_10.42.42.2(pid=22766): stdout: | (launched: 2022-12-12_20:09:08.331343) 20:09:11.901702 run osmo-hlr_10.42.42.2(pid=22766): stderr: | 20221212200908647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200908647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200908647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200908647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200908647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200908647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200908663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200908676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200908681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200908681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:11.951893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22765): Terminating (SIGTERM) 20:09:11.991910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22768): Terminating (SIGTERM) 20:09:12.032491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22771): Terminating (SIGTERM) 20:09:12.073069 --- ParallelTerminationStrategy: PID 22765 died... 20:09:12.092338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22765): Terminated: ok {rc=0} 20:09:12.136671 --- ParallelTerminationStrategy: PID 22768 died... 20:09:12.155507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22768): Terminated: ok {rc=0} 20:09:12.199505 --- ParallelTerminationStrategy: PID 22771 died... 20:09:12.218286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22771): Terminated: ok {rc=0} 20:09:12.305472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:09:13.395159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:13.407647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:09:13.477123 tst ping_idle_ping.py: using LAC 31205 20:09:13.595796 tst ping_idle_ping.py: using RAC 95 20:09:13.715606 tst ping_idle_ping.py: using CellId 31205 20:09:13.835272 tst ping_idle_ping.py: using BVCI 31206 20:09:13.945833 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:13.957165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:13.968184 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:13.979222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:13.990190 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:14.001361 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:14.012501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:09:14.023532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:09:14.139658 tst ping_idle_ping.py:24: start network... 20:09:14.341681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:14.812897 run create_hlr_db(pid=22773): Launched 20:09:14.939305 bus /gobi_6: Setting Powered False 20:09:16.021720 run create_hlr_db(pid=22773): Terminated: ok {rc=0} 20:09:16.454707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22775): Launched 20:09:16.778102 run osmo-hlr_10.42.42.2(pid=22776): Launched 20:09:17.018794 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:17.675020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22778): Launched 20:09:18.005786 run osmo-stp_10.42.42.5(pid=22779): Launched 20:09:18.137400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:09:18.699108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22781): Launched 20:09:18.824670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:09:19.100270 run patchelf(pid=22782): Launched 20:09:19.282318 run osmo-stp_10.42.42.5(pid=22779): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22779)] 20:09:19.419847 run osmo-stp_10.42.42.5(pid=22779): stdout: | (launched: 2022-12-12_20:09:17.941105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:19.559622 run osmo-stp_10.42.42.5(pid=22779): stderr: | 20221212200918139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200918140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200918140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200918140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200918141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200918141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200918141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:19.699312 run osmo-stp_10.42.42.5(pid=22779): stdout: | (launched: 2022-12-12_20:09:17.941105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:19.832067 run osmo-stp_10.42.42.5(pid=22779): stderr: | 20221212200918139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200918140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200918140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200918140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200918141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200918141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200918141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:20.000501 run patchelf(pid=22782): Terminating (SIGINT) 20:09:20.181892 run patchelf(pid=22782): Terminated: ok {rc=0} 20:09:20.312111 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22779): Process ended prematurely: osmo-stp_10.42.42.5(pid=22779) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22779)] [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:09:20.321993 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 20:09:20.351153 run osmo-hlr_10.42.42.2(pid=22776): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22776)] 20:09:20.402289 run osmo-hlr_10.42.42.2(pid=22776): stdout: | (launched: 2022-12-12_20:09:16.720047) 20:09:20.455422 run osmo-hlr_10.42.42.2(pid=22776): stderr: | 20221212200917060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200917060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200917060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200917060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200917065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200917065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200917080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200917096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200917097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200917097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:20.508907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22775): Terminating (SIGTERM) 20:09:20.551836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22778): Terminating (SIGTERM) 20:09:20.594915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22781): Terminating (SIGTERM) 20:09:20.637983 --- ParallelTerminationStrategy: PID 22775 died... 20:09:20.658520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22775): Terminated: ok {rc=0} 20:09:20.706269 --- ParallelTerminationStrategy: PID 22778 died... 20:09:20.726439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22778): Terminated: ok {rc=0} 20:09:20.773906 --- ParallelTerminationStrategy: PID 22781 died... 20:09:20.793893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22781): Terminated: ok {rc=0} 20:09:20.884913 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:09:22.188501 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:22.197685 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:09:22.228525 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:09:22.265655 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:09:22.322759 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:09:22.353612 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:09:22.389341 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:09:22.947875 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:09:22.953657 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:22.965784 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:09:23.033670 tst switch_tch_pdch.py: using LAC 31206 20:09:23.159450 tst switch_tch_pdch.py: using RAC 96 20:09:23.284174 tst switch_tch_pdch.py: using CellId 31206 20:09:23.409682 tst switch_tch_pdch.py: using BVCI 31207 20:09:23.527288 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:23.539446 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:23.551425 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:23.563710 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:23.576002 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:23.588334 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:23.600741 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:09:23.613150 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:23.730143 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:23.851969 tst switch_tch_pdch.py:51: start network... 20:09:24.068908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:24.568703 run create_hlr_db(pid=22786): Launched 20:09:24.691441 bus /gobi_6: Setting Powered False 20:09:25.755237 run create_hlr_db(pid=22786): Terminated: ok {rc=0} 20:09:26.192228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22788): Launched 20:09:26.497984 run osmo-hlr_10.42.42.2(pid=22789): Launched 20:09:26.614684 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:27.137937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22791): Launched 20:09:27.439852 run osmo-stp_10.42.42.5(pid=22792): Launched 20:09:27.558403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:09:28.079825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22794): Launched 20:09:28.196618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:09:28.451995 run patchelf(pid=22795): Launched 20:09:28.621364 run osmo-stp_10.42.42.5(pid=22792): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22792)] 20:09:28.748595 run osmo-stp_10.42.42.5(pid=22792): stdout: | (launched: 2022-12-12_20:09:27.383105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:28.877724 run osmo-stp_10.42.42.5(pid=22792): stderr: | 20221212200927556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200927556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200927556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200927557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200927557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200927557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200927557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:29.006974 run osmo-stp_10.42.42.5(pid=22792): stdout: | (launched: 2022-12-12_20:09:27.383105) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:29.129989 run osmo-stp_10.42.42.5(pid=22792): stderr: | 20221212200927556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200927556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200927556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200927557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200927557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200927557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200927557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:29.275767 run patchelf(pid=22795): Terminating (SIGINT) 20:09:29.443625 run patchelf(pid=22795): Terminated: ok {rc=0} 20:09:29.564454 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22792): Process ended prematurely: osmo-stp_10.42.42.5(pid=22792) [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22792)] [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:09:29.573631 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:09:29.600656 run osmo-hlr_10.42.42.2(pid=22789): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22789)] 20:09:29.649316 run osmo-hlr_10.42.42.2(pid=22789): stdout: | (launched: 2022-12-12_20:09:26.440902) 20:09:29.699348 run osmo-hlr_10.42.42.2(pid=22789): stderr: | 20221212200926618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200926618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200926618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200926618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200926618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200926618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200926631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200926640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200926640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200926640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:29.749673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22788): Terminating (SIGTERM) 20:09:29.789508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22791): Terminating (SIGTERM) 20:09:29.829415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22794): Terminating (SIGTERM) 20:09:29.869426 --- ParallelTerminationStrategy: PID 22788 died... 20:09:29.888626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22788): Terminated: ok {rc=0} 20:09:29.933318 --- ParallelTerminationStrategy: PID 22791 died... 20:09:29.952244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22791): Terminated: ok {rc=0} 20:09:29.996501 --- ParallelTerminationStrategy: PID 22794 died... 20:09:30.015301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22794): Terminated: ok {rc=0} 20:09:30.100119 bus /gobi_0: Setting Powered False 20:09:31.194656 bus /gobi_0: Setting Powered False 20:09:32.308013 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:09:33.561038 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:33.566946 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:09:33.595935 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:09:33.630476 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:09:33.683815 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:09:33.712808 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:09:33.746841 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:09:34.305521 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:09:34.310542 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.321892 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:09:34.388154 tst switch_tch_pdch.py: using LAC 31207 20:09:34.518306 tst switch_tch_pdch.py: using RAC 97 20:09:34.646456 tst switch_tch_pdch.py: using CellId 31207 20:09:34.771681 tst switch_tch_pdch.py: using BVCI 31208 20:09:34.890054 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.902177 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.913784 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.925684 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.937350 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.949351 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.961291 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:09:34.973028 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:09:35.092141 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:09:35.208631 tst switch_tch_pdch.py:51: start network... 20:09:35.409617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:35.852187 run create_hlr_db(pid=22802): Launched 20:09:35.976492 bus /gobi_6: Setting Powered False 20:09:37.037951 run create_hlr_db(pid=22802): Terminated: ok {rc=0} 20:09:37.452840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Launched 20:09:37.778850 run osmo-hlr_10.42.42.2(pid=22805): Launched 20:09:37.904574 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:38.436319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Launched 20:09:38.761541 run osmo-stp_10.42.42.5(pid=22808): Launched 20:09:38.885314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:09:39.416524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Launched 20:09:39.541774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:09:39.815846 run patchelf(pid=22811): Launched 20:09:39.998002 run osmo-stp_10.42.42.5(pid=22808): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] 20:09:40.134677 run osmo-stp_10.42.42.5(pid=22808): stdout: | (launched: 2022-12-12_20:09:38.701236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:40.273148 run osmo-stp_10.42.42.5(pid=22808): stderr: | 20221212200938895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200938896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200938896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200938896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200938897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200938897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200938897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:40.411726 run osmo-stp_10.42.42.5(pid=22808): stdout: | (launched: 2022-12-12_20:09:38.701236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:40.544244 run osmo-stp_10.42.42.5(pid=22808): stderr: | 20221212200938895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200938896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200938896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200938896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200938897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200938897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200938897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:40.701686 run patchelf(pid=22811): Terminating (SIGINT) 20:09:40.882092 run patchelf(pid=22811): Terminated: ok {rc=0} 20:09:41.013251 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22808): Process ended prematurely: osmo-stp_10.42.42.5(pid=22808) [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:09:41.022939 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:09:41.052183 run osmo-hlr_10.42.42.2(pid=22805): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22805)] 20:09:41.103576 run osmo-hlr_10.42.42.2(pid=22805): stdout: | (launched: 2022-12-12_20:09:37.718801) 20:09:41.156620 run osmo-hlr_10.42.42.2(pid=22805): stderr: | 20221212200937918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200937918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200937918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200937919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200937919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200937919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200937931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200937939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200937940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200937940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:41.210050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Terminating (SIGTERM) 20:09:41.252936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Terminating (SIGTERM) 20:09:41.295879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Terminating (SIGTERM) 20:09:41.338976 --- ParallelTerminationStrategy: PID 22804 died... 20:09:41.359245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Terminated: ok {rc=0} 20:09:41.406755 --- ParallelTerminationStrategy: PID 22807 died... 20:09:41.426598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Terminated: ok {rc=0} 20:09:41.473914 --- ParallelTerminationStrategy: PID 22810 died... 20:09:41.493790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Terminated: ok {rc=0} 20:09:41.582763 bus /gobi_0: Setting Powered False 20:09:42.681575 bus /gobi_0: Setting Powered False 20:09:43.797743 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_sms:nanobts --------------------------------------------------------------------- 20:09:45.044919 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:45.048681 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 20:09:45.072413 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 20:09:45.079143 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 20:09:45.131568 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 20:09:45.155302 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 20:09:45.162057 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 20:09:45.703641 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 20:09:45.708585 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 20:09:45.719451 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 20:09:45.757084 tst mo_mt_sms.py: using LAC 31208 20:09:45.884882 tst mo_mt_sms.py: using RAC 98 20:09:46.012876 tst mo_mt_sms.py: using CellId 31208 20:09:46.179861 tst mo_mt_sms.py: using BVCI 31209 20:09:46.304272 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 20:09:46.431760 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 20:09:46.567635 tst mo_mt_sms.py:9: start nitb and bts... 20:09:46.847448 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:09:47.523368 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22815): Launched 20:09:47.849758 run osmo-nitb_10.42.42.2(pid=22816): Launched 20:09:48.029388 run osmo-nitb_10.42.42.2(pid=22816): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22816)] 20:09:48.174330 run osmo-nitb_10.42.42.2(pid=22816): stdout: | (launched: 2022-12-12_20:09:47.789681) 20:09:48.321293 run osmo-nitb_10.42.42.2(pid=22816): stderr: | (launched: 2022-12-12_20:09:47.837578) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:09:48.467985 run osmo-nitb_10.42.42.2(pid=22816): stdout: | (launched: 2022-12-12_20:09:47.789681) 20:09:48.608510 run osmo-nitb_10.42.42.2(pid=22816): stderr: | (launched: 2022-12-12_20:09:47.837578) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22816) [trial-2381↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22816)] 20:09:48.971773 tst osmo-nitb_10.42.42.2(pid=22816): stdout: | (launched: 2022-12-12_20:09:47.789681) 20:09:49.102352 tst osmo-nitb_10.42.42.2(pid=22816): stderr: | (launched: 2022-12-12_20:09:47.837578) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:09:49.255917 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22816) [trial-2381↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22816)] [trial-2381↪nitb_sms:nanobts↪mo_mt_sms.py:11] 20:09:49.265238 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 20:09:49.272468 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22815): Terminating (SIGTERM) 20:09:49.484370 --- ParallelTerminationStrategy: PID 22815 died... 20:09:49.506215 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22815): Terminated: ok {rc=0} 20:09:49.595776 bus /sierra_3: Setting Powered False 20:09:50.697329 bus /sierra_3: Setting Powered False 20:09:51.817542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:nanobts+band-1900 --------------------------------------------------------------------- 20:09:53.010635 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:53.016238 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 20:09:53.041348 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 20:09:53.069517 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 20:09:53.121744 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 20:09:53.145997 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 20:09:53.173494 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 20:09:53.723626 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 20:09:53.728829 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:09:53.740501 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:09:53.780462 tst mo_mt_sms.py: using LAC 31209 20:09:53.905717 tst mo_mt_sms.py: using RAC 99 20:09:54.022292 tst mo_mt_sms.py: using CellId 31209 20:09:54.138883 tst mo_mt_sms.py: using BVCI 31210 20:09:54.248594 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:09:54.259549 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:09:54.270519 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:09:54.281239 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:09:54.291839 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:09:54.302469 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 20:09:54.421768 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 20:09:54.542512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:55.044548 run create_hlr_db(pid=22820): Launched 20:09:55.170886 bus /sierra_2: Setting Powered False 20:09:56.234499 run create_hlr_db(pid=22820): Terminated: ok {rc=0} 20:09:56.686587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22822): Launched 20:09:57.011126 run osmo-hlr_10.42.42.2(pid=22823): Launched 20:09:57.135289 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:57.694636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22825): Launched 20:09:58.019909 run osmo-stp_10.42.42.5(pid=22826): Launched 20:09:58.144838 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:58.731443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22828): Launched 20:09:59.056477 run osmo-msc_10.42.42.6(pid=22829): Launched 20:09:59.237678 run osmo-stp_10.42.42.5(pid=22826): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22826)] 20:09:59.373832 run osmo-stp_10.42.42.5(pid=22826): stdout: | (launched: 2022-12-12_20:09:57.959987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:59.510821 run osmo-stp_10.42.42.5(pid=22826): stderr: | 20221212200958152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200958152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200958152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200958152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200958153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200958153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200958153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:59.646866 run osmo-stp_10.42.42.5(pid=22826): stdout: | (launched: 2022-12-12_20:09:57.959987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:59.776319 run osmo-stp_10.42.42.5(pid=22826): stderr: | 20221212200958152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212200958152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212200958152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212200958152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212200958153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212200958153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212200958153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:59.931050 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22826): Process ended prematurely: osmo-stp_10.42.42.5(pid=22826) [trial-2381↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22826)] [trial-2381↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 20:09:59.939971 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 20:09:59.968501 run osmo-hlr_10.42.42.2(pid=22823): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22823)] 20:10:00.019684 run osmo-hlr_10.42.42.2(pid=22823): stdout: | (launched: 2022-12-12_20:09:56.950610) 20:10:00.072637 run osmo-hlr_10.42.42.2(pid=22823): stderr: | 20221212200957151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212200957151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212200957151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212200957152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212200957152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212200957152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212200957163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212200957171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212200957172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212200957172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:00.146097 run osmo-msc_10.42.42.6(pid=22829): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22829)] 20:10:00.196922 run osmo-msc_10.42.42.6(pid=22829): stdout: | (launched: 2022-12-12_20:09:58.996122) 20:10:00.250132 run osmo-msc_10.42.42.6(pid=22829): stderr: | 20221212200959321 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212200959322 DLGLOBAL DEBUG validating counter group 0x7fc466429c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212200959322 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212200959322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212200959322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212200959322 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212200959324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212200959324 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212200959324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212200959324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:00.303284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22822): Terminating (SIGTERM) 20:10:00.346180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22825): Terminating (SIGTERM) 20:10:00.388740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22828): Terminating (SIGTERM) 20:10:00.431828 --- ParallelTerminationStrategy: PID 22822 died... 20:10:00.452257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22822): Terminated: ok {rc=0} 20:10:00.499627 --- ParallelTerminationStrategy: PID 22825 died... 20:10:00.519475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22825): Terminated: ok {rc=0} 20:10:00.567117 --- ParallelTerminationStrategy: PID 22828 died... 20:10:00.586890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22828): Terminated: ok {rc=0} 20:10:00.676530 bus /sierra_3: Setting Powered False 20:10:01.772122 bus /sierra_3: Setting Powered False 20:10:02.890303 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 20:10:04.118038 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:10:04.123428 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 20:10:04.148721 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 20:10:04.157190 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 20:10:04.193894 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 20:10:04.218348 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 20:10:04.225299 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 20:10:04.745948 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 20:10:04.752016 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 20:10:04.764048 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:10:04.802672 tst assert_extension.py: using LAC 31210 20:10:04.920887 tst assert_extension.py: using RAC 100 20:10:05.039807 tst assert_extension.py: using CellId 31210 20:10:05.158193 tst assert_extension.py: using BVCI 31211 20:10:05.267335 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 20:10:05.385274 tst assert_extension.py:10: start nitb and bts... 20:10:05.603201 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:10:06.262520 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22838): Launched 20:10:06.587647 run osmo-nitb_10.42.42.2(pid=22839): Launched 20:10:06.767303 run osmo-nitb_10.42.42.2(pid=22839): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22839)] 20:10:06.912486 run osmo-nitb_10.42.42.2(pid=22839): stdout: | (launched: 2022-12-12_20:10:06.527332) 20:10:07.058625 run osmo-nitb_10.42.42.2(pid=22839): stderr: | (launched: 2022-12-12_20:10:06.575239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:10:07.205072 run osmo-nitb_10.42.42.2(pid=22839): stdout: | (launched: 2022-12-12_20:10:06.527332) 20:10:07.345084 run osmo-nitb_10.42.42.2(pid=22839): stderr: | (launched: 2022-12-12_20:10:06.575239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22839) [trial-2381↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22839)] 20:10:07.710072 tst osmo-nitb_10.42.42.2(pid=22839): stdout: | (launched: 2022-12-12_20:10:06.527332) 20:10:07.840677 tst osmo-nitb_10.42.42.2(pid=22839): stderr: | (launched: 2022-12-12_20:10:06.575239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:10:07.995394 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22839) [trial-2381↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22839)] [trial-2381↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 20:10:08.004778 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:10:08.011890 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22838): Terminating (SIGTERM) 20:10:08.224084 --- ParallelTerminationStrategy: PID 22838 died... 20:10:08.245924 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22838): Terminated: ok {rc=0} 20:10:08.335278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:nanobts+band-1900 --------------------------------------------------------------------- 20:10:09.507947 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:10:09.513945 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 20:10:09.537724 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 20:10:09.564368 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 20:10:09.599525 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 20:10:09.624406 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 20:10:09.652821 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 20:10:10.187294 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 20:10:10.193767 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:10:10.205606 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:10:10.252941 tst assert_extension.py: using LAC 31211 20:10:10.370667 tst assert_extension.py: using RAC 101 20:10:10.488540 tst assert_extension.py: using CellId 31211 20:10:10.604460 tst assert_extension.py: using BVCI 31212 20:10:10.712698 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:10:10.723496 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:10:10.734162 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:10:10.744705 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:10:10.755355 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:10:10.766051 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 20:10:10.883014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:11.384859 run create_hlr_db(pid=22844): Launched 20:10:11.508770 bus /sierra_2: Setting Powered False 20:10:12.572803 run create_hlr_db(pid=22844): Terminated: ok {rc=0} 20:10:13.007121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22846): Launched 20:10:13.312508 run osmo-hlr_10.42.42.2(pid=22847): Launched 20:10:13.430347 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:13.954800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22849): Launched 20:10:14.259905 run osmo-stp_10.42.42.5(pid=22850): Launched 20:10:14.377951 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:14.925666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22852): Launched 20:10:15.228565 run osmo-msc_10.42.42.6(pid=22853): Launched 20:10:15.399524 run osmo-stp_10.42.42.5(pid=22850): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22850)] 20:10:15.527112 run osmo-stp_10.42.42.5(pid=22850): stdout: | (launched: 2022-12-12_20:10:14.203093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:15.654511 run osmo-stp_10.42.42.5(pid=22850): stderr: | 20221212201014377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201014377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201014377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201014378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201014378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201014378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201014378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:15.779708 run osmo-stp_10.42.42.5(pid=22850): stdout: | (launched: 2022-12-12_20:10:14.203093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:15.915275 run osmo-stp_10.42.42.5(pid=22850): stderr: | 20221212201014377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201014377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201014377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201014378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201014378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201014378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201014378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:16.079029 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22850): Process ended prematurely: osmo-stp_10.42.42.5(pid=22850) [trial-2381↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22850)] [trial-2381↪ussd:nanobts+band-1900↪assert_extension.py:17] 20:10:16.087838 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:10:16.114675 run osmo-hlr_10.42.42.2(pid=22847): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22847)] 20:10:16.164320 run osmo-hlr_10.42.42.2(pid=22847): stdout: | (launched: 2022-12-12_20:10:13.255735) 20:10:16.215658 run osmo-hlr_10.42.42.2(pid=22847): stderr: | 20221212201013433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201013433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201013433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201013433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201013433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201013434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201013446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201013455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201013455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201013456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:16.286855 run osmo-msc_10.42.42.6(pid=22853): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22853)] 20:10:16.335870 run osmo-msc_10.42.42.6(pid=22853): stdout: | (launched: 2022-12-12_20:10:15.171823) 20:10:16.386576 run osmo-msc_10.42.42.6(pid=22853): stderr: | 20221212201015446 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201015447 DLGLOBAL DEBUG validating counter group 0x7f55c2c97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201015447 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201015447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201015447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201015447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201015449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201015449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201015449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201015449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:16.437742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22846): Terminating (SIGTERM) 20:10:16.478400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22849): Terminating (SIGTERM) 20:10:16.518963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22852): Terminating (SIGTERM) 20:10:16.560423 --- ParallelTerminationStrategy: PID 22846 died... 20:10:16.580143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22846): Terminated: ok {rc=0} 20:10:16.625459 --- ParallelTerminationStrategy: PID 22849 died... 20:10:16.644553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22849): Terminated: ok {rc=0} 20:10:16.689856 --- ParallelTerminationStrategy: PID 22852 died... 20:10:16.708935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22852): Terminated: ok {rc=0} 20:10:16.797038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:10:17.994881 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:10:18.002696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:10:18.026408 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:10:18.052834 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:10:18.106263 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:10:18.129702 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:10:18.156454 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:10:18.708219 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:10:18.758096 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:18.769573 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:10:18.830163 tst mo_mt_call.py: using LAC 31212 20:10:18.950583 tst mo_mt_call.py: using RAC 102 20:10:19.072206 tst mo_mt_call.py: using CellId 31212 20:10:19.193330 tst mo_mt_call.py: using BVCI 31213 20:10:19.304197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:19.315646 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:19.326770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:19.337903 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:19.349164 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:19.360337 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:10:19.480642 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:10:19.598883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:20.075313 run create_hlr_db(pid=22858): Launched 20:10:20.203594 bus /sierra_2: Setting Powered False 20:10:21.264643 run create_hlr_db(pid=22858): Terminated: ok {rc=0} 20:10:21.714637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22860): Launched 20:10:22.046973 run osmo-hlr_10.42.42.2(pid=22861): Launched 20:10:22.174628 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:22.744300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22864): Launched 20:10:23.076295 run osmo-stp_10.42.42.5(pid=22865): Launched 20:10:23.203159 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:23.800475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22867): Launched 20:10:24.132337 run osmo-msc_10.42.42.6(pid=22868): Launched 20:10:24.317529 run osmo-stp_10.42.42.5(pid=22865): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22865)] 20:10:24.456651 run osmo-stp_10.42.42.5(pid=22865): stdout: | (launched: 2022-12-12_20:10:23.014953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:24.595851 run osmo-stp_10.42.42.5(pid=22865): stderr: | 20221212201023207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201023207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201023207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201023208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201023210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201023210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201023210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:24.734057 run osmo-stp_10.42.42.5(pid=22865): stdout: | (launched: 2022-12-12_20:10:23.014953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:24.864912 run osmo-stp_10.42.42.5(pid=22865): stderr: | 20221212201023207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201023207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201023207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201023208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201023210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201023210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201023210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:25.021879 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22865): Process ended prematurely: osmo-stp_10.42.42.5(pid=22865) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22865)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:10:25.031724 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:10:25.061136 run osmo-hlr_10.42.42.2(pid=22861): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22861)] 20:10:25.112333 run osmo-hlr_10.42.42.2(pid=22861): stdout: | (launched: 2022-12-12_20:10:21.985884) 20:10:25.165235 run osmo-hlr_10.42.42.2(pid=22861): stderr: | 20221212201022188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201022188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201022188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201022188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201022188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201022188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201022200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201022209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201022209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201022209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:25.239011 run osmo-msc_10.42.42.6(pid=22868): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22868)] 20:10:25.290163 run osmo-msc_10.42.42.6(pid=22868): stdout: | (launched: 2022-12-12_20:10:24.071207) 20:10:25.342905 run osmo-msc_10.42.42.6(pid=22868): stderr: | 20221212201024393 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201024393 DLGLOBAL DEBUG validating counter group 0x7f6d55474c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201024394 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201024394 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201024394 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201024394 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201024397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201024398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201024398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201024398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:25.395955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22860): Terminating (SIGTERM) 20:10:25.438370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22864): Terminating (SIGTERM) 20:10:25.480633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22867): Terminating (SIGTERM) 20:10:25.523466 --- ParallelTerminationStrategy: PID 22860 died... 20:10:25.543831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22860): Terminated: ok {rc=0} 20:10:25.591240 --- ParallelTerminationStrategy: PID 22864 died... 20:10:25.611189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22864): Terminated: ok {rc=0} 20:10:25.658292 --- ParallelTerminationStrategy: PID 22867 died... 20:10:25.678214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22867): Terminated: ok {rc=0} 20:10:25.767503 bus /sierra_3: Setting Powered False 20:10:26.867876 bus /sierra_3: Setting Powered False 20:10:27.985984 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:10:29.138155 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:29.150909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:10:29.213457 tst mo_mt_call_osmux.py: using LAC 31213 20:10:29.334212 tst mo_mt_call_osmux.py: using RAC 103 20:10:29.455603 tst mo_mt_call_osmux.py: using CellId 31213 20:10:29.577491 tst mo_mt_call_osmux.py: using BVCI 31214 20:10:29.689218 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:29.700434 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:29.711571 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:29.722680 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:29.733908 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:10:29.744999 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:10:29.864126 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:10:29.987723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:30.499721 run create_hlr_db(pid=22870): Launched 20:10:30.627133 bus /sierra_2: Setting Powered False 20:10:31.691316 run create_hlr_db(pid=22870): Terminated: ok {rc=0} 20:10:32.194805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22872): Launched 20:10:32.532333 run osmo-hlr_10.42.42.2(pid=22873): Launched 20:10:32.661078 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:33.232730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22875): Launched 20:10:33.563873 run osmo-stp_10.42.42.5(pid=22876): Launched 20:10:33.691421 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:34.287678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22878): Launched 20:10:34.620177 run osmo-msc_10.42.42.6(pid=22879): Launched 20:10:34.804085 run osmo-stp_10.42.42.5(pid=22876): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22876)] 20:10:34.943083 run osmo-stp_10.42.42.5(pid=22876): stdout: | (launched: 2022-12-12_20:10:33.502699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:35.082907 run osmo-stp_10.42.42.5(pid=22876): stderr: | 20221212201033697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201033697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201033697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201033698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201033698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201033698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201033698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:35.221163 run osmo-stp_10.42.42.5(pid=22876): stdout: | (launched: 2022-12-12_20:10:33.502699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:35.351620 run osmo-stp_10.42.42.5(pid=22876): stderr: | 20221212201033697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201033697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201033697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201033698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201033698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201033698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201033698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:35.508497 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22876): Process ended prematurely: osmo-stp_10.42.42.5(pid=22876) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22876)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:10:35.518600 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:10:35.547181 run osmo-hlr_10.42.42.2(pid=22873): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22873)] 20:10:35.598593 run osmo-hlr_10.42.42.2(pid=22873): stdout: | (launched: 2022-12-12_20:10:32.471204) 20:10:35.651295 run osmo-hlr_10.42.42.2(pid=22873): stderr: | 20221212201032673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201032673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201032673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201032673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201032674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201032674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201032690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201032698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201032698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201032698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:35.724769 run osmo-msc_10.42.42.6(pid=22879): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22879)] 20:10:35.775619 run osmo-msc_10.42.42.6(pid=22879): stdout: | (launched: 2022-12-12_20:10:34.558418) 20:10:35.828102 run osmo-msc_10.42.42.6(pid=22879): stderr: | 20221212201034887 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201034887 DLGLOBAL DEBUG validating counter group 0x7f93e3162c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201034887 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201034887 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201034887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201034888 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201034889 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201034890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201034890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201034890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:35.881393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22872): Terminating (SIGTERM) 20:10:35.923953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22875): Terminating (SIGTERM) 20:10:35.966971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22878): Terminating (SIGTERM) 20:10:36.009895 --- ParallelTerminationStrategy: PID 22872 died... 20:10:36.030293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22872): Terminated: ok {rc=0} 20:10:36.077833 --- ParallelTerminationStrategy: PID 22875 died... 20:10:36.097705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22875): Terminated: ok {rc=0} 20:10:36.145428 --- ParallelTerminationStrategy: PID 22878 died... 20:10:36.165150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22878): Terminated: ok {rc=0} 20:10:36.255176 bus /sierra_3: Setting Powered False 20:10:37.353378 bus /sierra_3: Setting Powered False 20:10:38.469831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:10:39.715246 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:10:39.722867 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:10:39.746617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:10:39.773187 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:10:39.827032 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:10:39.851016 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:10:39.877260 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:10:40.427544 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:10:40.476646 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:40.488398 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:10:40.547863 tst mo_mt_call.py: using LAC 31214 20:10:40.668997 tst mo_mt_call.py: using RAC 104 20:10:40.788854 tst mo_mt_call.py: using CellId 31214 20:10:40.909190 tst mo_mt_call.py: using BVCI 31215 20:10:41.020909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:41.032193 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:41.043264 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:41.054513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:41.065645 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:41.076741 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:10:41.197924 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:10:41.319384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:41.829686 run create_hlr_db(pid=22884): Launched 20:10:41.958436 bus /sierra_2: Setting Powered False 20:10:43.023340 run create_hlr_db(pid=22884): Terminated: ok {rc=0} 20:10:43.463878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22886): Launched 20:10:43.775023 run osmo-hlr_10.42.42.2(pid=22887): Launched 20:10:43.894516 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:44.423920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22890): Launched 20:10:44.734036 run osmo-stp_10.42.42.5(pid=22891): Launched 20:10:44.854144 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:45.411282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22893): Launched 20:10:45.721714 run osmo-msc_10.42.42.6(pid=22894): Launched 20:10:46.000838 run osmo-stp_10.42.42.5(pid=22891): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22891)] 20:10:46.262727 run osmo-stp_10.42.42.5(pid=22891): stdout: | (launched: 2022-12-12_20:10:44.676370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:46.435992 run osmo-stp_10.42.42.5(pid=22891): stderr: | 20221212201044849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201044850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201044850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201044850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201044851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201044851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201044851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:46.591651 run osmo-stp_10.42.42.5(pid=22891): stdout: | (launched: 2022-12-12_20:10:44.676370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:46.731793 run osmo-stp_10.42.42.5(pid=22891): stderr: | 20221212201044849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201044850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201044850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201044850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201044851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201044851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201044851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:46.894866 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22891): Process ended prematurely: osmo-stp_10.42.42.5(pid=22891) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22891)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:10:46.905727 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:10:46.937950 run osmo-hlr_10.42.42.2(pid=22887): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22887)] 20:10:46.992326 run osmo-hlr_10.42.42.2(pid=22887): stdout: | (launched: 2022-12-12_20:10:43.717432) 20:10:47.047860 run osmo-hlr_10.42.42.2(pid=22887): stderr: | 20221212201043897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201043897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201043897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201043897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201043897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201043897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201043923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201043933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201043933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201043933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:47.126111 run osmo-msc_10.42.42.6(pid=22894): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22894)] 20:10:47.179456 run osmo-msc_10.42.42.6(pid=22894): stdout: | (launched: 2022-12-12_20:10:45.663504) 20:10:47.234909 run osmo-msc_10.42.42.6(pid=22894): stderr: | 20221212201046010 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201046010 DLGLOBAL DEBUG validating counter group 0x7f67fc010c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201046010 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201046010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201046010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201046010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201046018 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201046018 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201046018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201046018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:47.291736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22886): Terminating (SIGTERM) 20:10:47.336634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22890): Terminating (SIGTERM) 20:10:47.380567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22893): Terminating (SIGTERM) 20:10:47.424615 --- ParallelTerminationStrategy: PID 22886 died... 20:10:47.445227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22886): Terminated: ok {rc=0} 20:10:47.494198 --- ParallelTerminationStrategy: PID 22890 died... 20:10:47.514055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22890): Terminated: ok {rc=0} 20:10:47.561703 --- ParallelTerminationStrategy: PID 22893 died... 20:10:47.581666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22893): Terminated: ok {rc=0} 20:10:47.671690 bus /sierra_3: Setting Powered False 20:10:48.769967 bus /sierra_3: Setting Powered False 20:10:49.887466 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:10:51.040492 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:51.053426 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:10:51.115776 tst mo_mt_call_osmux.py: using LAC 31215 20:10:51.246327 tst mo_mt_call_osmux.py: using RAC 105 20:10:51.373599 tst mo_mt_call_osmux.py: using CellId 31215 20:10:51.501650 tst mo_mt_call_osmux.py: using BVCI 31216 20:10:51.622070 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:51.633906 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:51.645519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:51.657529 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:51.669589 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:10:51.681419 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:10:51.801655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:10:51.920749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:52.397276 run create_hlr_db(pid=22896): Launched 20:10:52.524441 bus /sierra_2: Setting Powered False 20:10:53.585993 run create_hlr_db(pid=22896): Terminated: ok {rc=0} 20:10:54.036279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22898): Launched 20:10:54.369188 run osmo-hlr_10.42.42.2(pid=22899): Launched 20:10:54.497618 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:55.067500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22901): Launched 20:10:55.400496 run osmo-stp_10.42.42.5(pid=22902): Launched 20:10:55.528030 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:56.127816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22904): Launched 20:10:56.460414 run osmo-msc_10.42.42.6(pid=22905): Launched 20:10:56.646797 run osmo-stp_10.42.42.5(pid=22902): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22902)] 20:10:56.787286 run osmo-stp_10.42.42.5(pid=22902): stdout: | (launched: 2022-12-12_20:10:55.339388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:56.926948 run osmo-stp_10.42.42.5(pid=22902): stderr: | 20221212201055535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201055535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201055535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201055536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201055536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201055536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201055536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:57.065478 run osmo-stp_10.42.42.5(pid=22902): stdout: | (launched: 2022-12-12_20:10:55.339388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:57.196560 run osmo-stp_10.42.42.5(pid=22902): stderr: | 20221212201055535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201055535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201055535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201055536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201055536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201055536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201055536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:57.353397 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22902): Process ended prematurely: osmo-stp_10.42.42.5(pid=22902) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22902)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:10:57.363330 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:10:57.392706 run osmo-hlr_10.42.42.2(pid=22899): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22899)] 20:10:57.444218 run osmo-hlr_10.42.42.2(pid=22899): stdout: | (launched: 2022-12-12_20:10:54.307570) 20:10:57.497462 run osmo-hlr_10.42.42.2(pid=22899): stderr: | 20221212201054508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201054508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201054508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201054508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201054508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201054508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201054538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201054548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201054548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201054548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:57.571298 run osmo-msc_10.42.42.6(pid=22905): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22905)] 20:10:57.622425 run osmo-msc_10.42.42.6(pid=22905): stdout: | (launched: 2022-12-12_20:10:56.399077) 20:10:57.675248 run osmo-msc_10.42.42.6(pid=22905): stderr: | 20221212201056725 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201056725 DLGLOBAL DEBUG validating counter group 0x7fbfd339ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201056725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201056725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201056725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201056725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201056727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201056727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201056728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201056728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:57.728494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22898): Terminating (SIGTERM) 20:10:57.771418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22901): Terminating (SIGTERM) 20:10:57.814091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22904): Terminating (SIGTERM) 20:10:57.857088 --- ParallelTerminationStrategy: PID 22898 died... 20:10:57.877293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22898): Terminated: ok {rc=0} 20:10:57.924876 --- ParallelTerminationStrategy: PID 22901 died... 20:10:57.945154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22901): Terminated: ok {rc=0} 20:10:57.992543 --- ParallelTerminationStrategy: PID 22904 died... 20:10:58.012587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22904): Terminated: ok {rc=0} 20:10:58.102010 bus /sierra_3: Setting Powered False 20:10:59.204102 bus /sierra_3: Setting Powered False 20:11:00.324810 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:11:01.572644 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:11:01.582523 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:11:01.609513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:11:01.638357 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:11:01.694042 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:11:01.724146 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:11:01.760288 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:11:02.298634 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:11:02.349970 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:02.361518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:11:02.422016 tst mo_mt_call.py: using LAC 31216 20:11:02.543198 tst mo_mt_call.py: using RAC 106 20:11:02.665584 tst mo_mt_call.py: using CellId 31216 20:11:02.786957 tst mo_mt_call.py: using BVCI 31217 20:11:02.902044 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:02.913569 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:02.924555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:02.936319 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:02.948066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:02.959731 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:11:03.084175 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:11:03.204642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:03.715010 run create_hlr_db(pid=22910): Launched 20:11:03.843556 bus /sierra_2: Setting Powered False 20:11:04.908188 run create_hlr_db(pid=22910): Terminated: ok {rc=0} 20:11:05.349715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Launched 20:11:05.658855 run osmo-hlr_10.42.42.2(pid=22913): Launched 20:11:05.777390 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:06.323826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Launched 20:11:06.634843 run osmo-stp_10.42.42.5(pid=22916): Launched 20:11:06.754678 run osmo-msc_10.42.42.6: Starting osmo-msc 20:11:07.311054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22918): Launched 20:11:07.621106 run osmo-msc_10.42.42.6(pid=22919): Launched 20:11:07.794292 run osmo-stp_10.42.42.5(pid=22916): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] 20:11:07.924111 run osmo-stp_10.42.42.5(pid=22916): stdout: | (launched: 2022-12-12_20:11:06.576655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:08.054141 run osmo-stp_10.42.42.5(pid=22916): stderr: | 20221212201106749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201106749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201106749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201106750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201106750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201106750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201106750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:08.181818 run osmo-stp_10.42.42.5(pid=22916): stdout: | (launched: 2022-12-12_20:11:06.576655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:08.303618 run osmo-stp_10.42.42.5(pid=22916): stderr: | 20221212201106749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201106749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201106749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201106750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201106750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201106750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201106750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:08.449683 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22916): Process ended prematurely: osmo-stp_10.42.42.5(pid=22916) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:11:08.458908 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:11:08.485927 run osmo-hlr_10.42.42.2(pid=22913): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22913)] 20:11:08.534250 run osmo-hlr_10.42.42.2(pid=22913): stdout: | (launched: 2022-12-12_20:11:05.601297) 20:11:08.584476 run osmo-hlr_10.42.42.2(pid=22913): stderr: | 20221212201105781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201105781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201105781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201105781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201105782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201105782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201105794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201105803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201105803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201105803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:08.654609 run osmo-msc_10.42.42.6(pid=22919): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22919)] 20:11:08.702908 run osmo-msc_10.42.42.6(pid=22919): stdout: | (launched: 2022-12-12_20:11:07.563285) 20:11:08.752878 run osmo-msc_10.42.42.6(pid=22919): stderr: | 20221212201107839 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201107839 DLGLOBAL DEBUG validating counter group 0x7f6490d43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201107840 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201107840 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201107840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201107840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201107842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201107842 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201107842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201107842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:11:08.803431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Terminating (SIGTERM) 20:11:08.843620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Terminating (SIGTERM) 20:11:08.883982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22918): Terminating (SIGTERM) 20:11:08.924719 --- ParallelTerminationStrategy: PID 22912 died... 20:11:08.944571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22912): Terminated: ok {rc=0} 20:11:08.989492 --- ParallelTerminationStrategy: PID 22915 died... 20:11:09.008476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22915): Terminated: ok {rc=0} 20:11:09.052934 --- ParallelTerminationStrategy: PID 22918 died... 20:11:09.072207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22918): Terminated: ok {rc=0} 20:11:09.157079 bus /sierra_3: Setting Powered False 20:11:10.257383 bus /sierra_3: Setting Powered False 20:11:11.375866 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:11:12.527503 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:12.540198 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:11:12.603077 tst mo_mt_call_osmux.py: using LAC 31217 20:11:12.731525 tst mo_mt_call_osmux.py: using RAC 107 20:11:12.860894 tst mo_mt_call_osmux.py: using CellId 31217 20:11:12.989263 tst mo_mt_call_osmux.py: using BVCI 31218 20:11:13.109735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:13.121552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:13.133268 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:13.145206 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:13.157323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:11:13.169324 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:11:13.290947 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:11:13.411315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:13.888232 run create_hlr_db(pid=22921): Launched 20:11:14.015942 bus /sierra_2: Setting Powered False 20:11:15.078307 run create_hlr_db(pid=22921): Terminated: ok {rc=0} 20:11:15.528135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22923): Launched 20:11:15.869711 run osmo-hlr_10.42.42.2(pid=22924): Launched 20:11:16.025522 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:16.721024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22926): Launched 20:11:17.066991 run osmo-stp_10.42.42.5(pid=22927): Launched 20:11:17.201917 run osmo-msc_10.42.42.6: Starting osmo-msc 20:11:17.880282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22929): Launched 20:11:18.213942 run osmo-msc_10.42.42.6(pid=22930): Launched 20:11:18.398759 run osmo-stp_10.42.42.5(pid=22927): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22927)] 20:11:18.538715 run osmo-stp_10.42.42.5(pid=22927): stdout: | (launched: 2022-12-12_20:11:17.005894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:18.677143 run osmo-stp_10.42.42.5(pid=22927): stderr: | 20221212201117322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201117323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201117323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201117323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201117324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201117324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201117324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:18.814163 run osmo-stp_10.42.42.5(pid=22927): stdout: | (launched: 2022-12-12_20:11:17.005894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:18.945377 run osmo-stp_10.42.42.5(pid=22927): stderr: | 20221212201117322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201117323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201117323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201117323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201117324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201117324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201117324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:19.103479 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22927): Process ended prematurely: osmo-stp_10.42.42.5(pid=22927) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22927)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:11:19.113310 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:11:19.142166 run osmo-hlr_10.42.42.2(pid=22924): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22924)] 20:11:19.193563 run osmo-hlr_10.42.42.2(pid=22924): stdout: | (launched: 2022-12-12_20:11:15.800021) 20:11:19.246641 run osmo-hlr_10.42.42.2(pid=22924): stderr: | 20221212201116151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201116151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201116151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201116151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201116151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201116151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201116174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201116187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201116187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201116187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:19.320826 run osmo-msc_10.42.42.6(pid=22930): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22930)] 20:11:19.371762 run osmo-msc_10.42.42.6(pid=22930): stdout: | (launched: 2022-12-12_20:11:18.151974) 20:11:19.424701 run osmo-msc_10.42.42.6(pid=22930): stderr: | 20221212201118478 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201118478 DLGLOBAL DEBUG validating counter group 0x7fd9fe49fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201118478 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201118478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201118478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201118479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201118480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201118481 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201118481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201118481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:11:19.477885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22923): Terminating (SIGTERM) 20:11:19.520416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22926): Terminating (SIGTERM) 20:11:19.563184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22929): Terminating (SIGTERM) 20:11:19.606384 --- ParallelTerminationStrategy: PID 22923 died... 20:11:19.626829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22923): Terminated: ok {rc=0} 20:11:19.674544 --- ParallelTerminationStrategy: PID 22926 died... 20:11:19.694567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22926): Terminated: ok {rc=0} 20:11:19.742040 --- ParallelTerminationStrategy: PID 22929 died... 20:11:19.761918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22929): Terminated: ok {rc=0} 20:11:19.851778 bus /sierra_3: Setting Powered False 20:11:20.949401 bus /sierra_3: Setting Powered False 20:11:22.065542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:11:23.308537 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:11:23.315952 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:11:23.339696 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:11:23.366182 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:11:23.419373 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:11:23.443135 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:11:23.469643 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:11:24.019100 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:11:24.067960 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:24.079257 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:11:24.138518 tst mo_mt_call.py: using LAC 31218 20:11:24.259096 tst mo_mt_call.py: using RAC 108 20:11:24.380674 tst mo_mt_call.py: using CellId 31218 20:11:24.501149 tst mo_mt_call.py: using BVCI 31219 20:11:24.611346 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:24.622781 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:24.633908 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:24.645062 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:24.656234 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:24.667447 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:11:24.786700 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:11:24.905122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:25.416166 run create_hlr_db(pid=22935): Launched 20:11:25.543847 bus /sierra_2: Setting Powered False 20:11:26.609417 run create_hlr_db(pid=22935): Terminated: ok {rc=0} 20:11:27.048841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22937): Launched 20:11:27.359937 run osmo-hlr_10.42.42.2(pid=22938): Launched 20:11:27.478600 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:28.023429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22940): Launched 20:11:28.333654 run osmo-stp_10.42.42.5(pid=22941): Launched 20:11:28.452708 run osmo-msc_10.42.42.6: Starting osmo-msc 20:11:29.012803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22943): Launched 20:11:29.321232 run osmo-msc_10.42.42.6(pid=22944): Launched 20:11:29.493935 run osmo-stp_10.42.42.5(pid=22941): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22941)] 20:11:29.623047 run osmo-stp_10.42.42.5(pid=22941): stdout: | (launched: 2022-12-12_20:11:28.275733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:29.751747 run osmo-stp_10.42.42.5(pid=22941): stderr: | 20221212201128453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201128453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201128453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201128454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201128454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201128454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201128454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:29.879108 run osmo-stp_10.42.42.5(pid=22941): stdout: | (launched: 2022-12-12_20:11:28.275733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:30.000507 run osmo-stp_10.42.42.5(pid=22941): stderr: | 20221212201128453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201128453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201128453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201128454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201128454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201128454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201128454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:30.146119 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22941): Process ended prematurely: osmo-stp_10.42.42.5(pid=22941) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22941)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:11:30.155166 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:11:30.181977 run osmo-hlr_10.42.42.2(pid=22938): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22938)] 20:11:30.230013 run osmo-hlr_10.42.42.2(pid=22938): stdout: | (launched: 2022-12-12_20:11:27.302370) 20:11:30.279626 run osmo-hlr_10.42.42.2(pid=22938): stderr: | 20221212201127478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201127478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201127478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201127478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201127478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201127478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201127491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201127499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201127500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201127500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:30.348673 run osmo-msc_10.42.42.6(pid=22944): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22944)] 20:11:30.396719 run osmo-msc_10.42.42.6(pid=22944): stdout: | (launched: 2022-12-12_20:11:29.263419) 20:11:30.446250 run osmo-msc_10.42.42.6(pid=22944): stderr: | 20221212201129537 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201129537 DLGLOBAL DEBUG validating counter group 0x7fee75a5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201129538 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201129538 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201129538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201129538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201129540 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201129540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201129540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201129540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:11:30.496223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22937): Terminating (SIGTERM) 20:11:30.536092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22940): Terminating (SIGTERM) 20:11:30.576045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22943): Terminating (SIGTERM) 20:11:30.616378 --- ParallelTerminationStrategy: PID 22937 died... 20:11:30.635838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22937): Terminated: ok {rc=0} 20:11:30.680314 --- ParallelTerminationStrategy: PID 22940 died... 20:11:30.699232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22940): Terminated: ok {rc=0} 20:11:30.743329 --- ParallelTerminationStrategy: PID 22943 died... 20:11:30.762177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22943): Terminated: ok {rc=0} 20:11:30.853698 bus /sierra_3: Setting Powered False 20:11:31.957473 bus /sierra_3: Setting Powered False 20:11:33.073960 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:11:34.222578 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:34.234634 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:11:34.295474 tst mo_mt_call_osmux.py: using LAC 31219 20:11:34.415762 tst mo_mt_call_osmux.py: using RAC 109 20:11:34.537294 tst mo_mt_call_osmux.py: using CellId 31219 20:11:34.657134 tst mo_mt_call_osmux.py: using BVCI 31220 20:11:34.769320 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:34.780596 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:34.791811 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:34.803038 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:34.814258 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:11:34.825498 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:11:34.945631 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:11:35.067407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:35.578347 run create_hlr_db(pid=22946): Launched 20:11:35.706997 bus /sierra_2: Setting Powered False 20:11:36.772238 run create_hlr_db(pid=22946): Terminated: ok {rc=0} 20:11:37.214323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22948): Launched 20:11:37.524213 run osmo-hlr_10.42.42.2(pid=22949): Launched 20:11:37.641405 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:38.185995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22951): Launched 20:11:38.494927 run osmo-stp_10.42.42.5(pid=22952): Launched 20:11:38.613097 run osmo-msc_10.42.42.6: Starting osmo-msc 20:11:39.175092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22954): Launched 20:11:39.486595 run osmo-msc_10.42.42.6(pid=22955): Launched 20:11:39.660687 run osmo-stp_10.42.42.5(pid=22952): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22952)] 20:11:39.789645 run osmo-stp_10.42.42.5(pid=22952): stdout: | (launched: 2022-12-12_20:11:38.436896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:39.918545 run osmo-stp_10.42.42.5(pid=22952): stderr: | 20221212201138609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201138610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201138610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201138610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201138611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201138611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201138611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:40.045999 run osmo-stp_10.42.42.5(pid=22952): stdout: | (launched: 2022-12-12_20:11:38.436896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:40.167507 run osmo-stp_10.42.42.5(pid=22952): stderr: | 20221212201138609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201138610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201138610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201138610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201138611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201138611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201138611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:40.312787 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22952): Process ended prematurely: osmo-stp_10.42.42.5(pid=22952) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22952)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:11:40.321870 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:11:40.348596 run osmo-hlr_10.42.42.2(pid=22949): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22949)] 20:11:40.396648 run osmo-hlr_10.42.42.2(pid=22949): stdout: | (launched: 2022-12-12_20:11:37.466565) 20:11:40.446585 run osmo-hlr_10.42.42.2(pid=22949): stderr: | 20221212201137644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201137644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201137644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201137644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201137644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201137645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201137656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201137666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201137666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201137666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:40.516802 run osmo-msc_10.42.42.6(pid=22955): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22955)] 20:11:40.565333 run osmo-msc_10.42.42.6(pid=22955): stdout: | (launched: 2022-12-12_20:11:39.428475) 20:11:40.615300 run osmo-msc_10.42.42.6(pid=22955): stderr: | 20221212201139704 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201139704 DLGLOBAL DEBUG validating counter group 0x7f9f061b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201139704 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201139704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201139705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201139705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201139707 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201139707 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201139707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201139707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:11:40.665490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22948): Terminating (SIGTERM) 20:11:40.705462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22951): Terminating (SIGTERM) 20:11:40.745374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22954): Terminating (SIGTERM) 20:11:40.785631 --- ParallelTerminationStrategy: PID 22948 died... 20:11:40.804922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22948): Terminated: ok {rc=0} 20:11:40.849409 --- ParallelTerminationStrategy: PID 22951 died... 20:11:40.868272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22951): Terminated: ok {rc=0} 20:11:40.912547 --- ParallelTerminationStrategy: PID 22954 died... 20:11:40.931391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22954): Terminated: ok {rc=0} 20:11:41.015468 bus /sierra_3: Setting Powered False 20:11:42.111890 bus /sierra_3: Setting Powered False 20:11:43.226442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:11:44.468061 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:11:44.475529 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:11:44.499420 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:11:44.526158 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:11:44.579841 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:11:44.603904 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:11:44.630460 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:11:45.181210 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:11:45.230573 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:45.242130 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:11:45.302249 tst mo_mt_call.py: using LAC 31220 20:11:45.420847 tst mo_mt_call.py: using RAC 110 20:11:45.539760 tst mo_mt_call.py: using CellId 31220 20:11:45.660064 tst mo_mt_call.py: using BVCI 31221 20:11:45.771541 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:45.782910 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:45.794115 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:45.805391 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:45.816586 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:45.827765 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:11:45.981551 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:11:46.106298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:46.671727 run create_hlr_db(pid=22960): Launched 20:11:46.840283 bus /sierra_2: Setting Powered False 20:11:47.905779 run create_hlr_db(pid=22960): Terminated: ok {rc=0} 20:11:48.345740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22962): Launched 20:11:48.653958 run osmo-hlr_10.42.42.2(pid=22963): Launched 20:11:48.772800 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:49.317057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22965): Launched 20:11:49.626823 run osmo-stp_10.42.42.5(pid=22966): Launched 20:11:49.744674 run osmo-msc_10.42.42.6: Starting osmo-msc 20:11:50.303197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22968): Launched 20:11:50.612820 run osmo-msc_10.42.42.6(pid=22969): Launched 20:11:50.786541 run osmo-stp_10.42.42.5(pid=22966): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22966)] 20:11:50.916332 run osmo-stp_10.42.42.5(pid=22966): stdout: | (launched: 2022-12-12_20:11:49.568861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:51.045884 run osmo-stp_10.42.42.5(pid=22966): stderr: | 20221212201149743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201149743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201149744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201149744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201149745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201149745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201149745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:51.173477 run osmo-stp_10.42.42.5(pid=22966): stdout: | (launched: 2022-12-12_20:11:49.568861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:51.295881 run osmo-stp_10.42.42.5(pid=22966): stderr: | 20221212201149743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201149743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201149744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201149744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201149745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201149745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201149745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:51.441357 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22966): Process ended prematurely: osmo-stp_10.42.42.5(pid=22966) [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22966)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:11:51.450311 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:11:51.477184 run osmo-hlr_10.42.42.2(pid=22963): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22963)] 20:11:51.525484 run osmo-hlr_10.42.42.2(pid=22963): stdout: | (launched: 2022-12-12_20:11:48.596177) 20:11:51.575510 run osmo-hlr_10.42.42.2(pid=22963): stderr: | 20221212201148777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201148777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201148777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201148777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201148777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201148777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201148789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201148798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201148799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201148799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:51.645642 run osmo-msc_10.42.42.6(pid=22969): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22969)] 20:11:51.694276 run osmo-msc_10.42.42.6(pid=22969): stdout: | (launched: 2022-12-12_20:11:50.555087) 20:11:51.744126 run osmo-msc_10.42.42.6(pid=22969): stderr: | 20221212201150830 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201150830 DLGLOBAL DEBUG validating counter group 0x7f8a61e80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201150830 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201150830 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201150830 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201150831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201150834 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201150835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201150835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201150835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:11:51.794464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22962): Terminating (SIGTERM) 20:11:51.834969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22965): Terminating (SIGTERM) 20:11:51.874803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22968): Terminating (SIGTERM) 20:11:51.915059 --- ParallelTerminationStrategy: PID 22962 died... 20:11:51.934364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22962): Terminated: ok {rc=0} 20:11:51.978851 --- ParallelTerminationStrategy: PID 22965 died... 20:11:51.997722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22965): Terminated: ok {rc=0} 20:11:52.041874 --- ParallelTerminationStrategy: PID 22968 died... 20:11:52.060682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22968): Terminated: ok {rc=0} 20:11:52.146937 bus /sierra_3: Setting Powered False 20:11:53.248808 bus /sierra_3: Setting Powered False 20:11:54.364152 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:11:55.515391 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:55.527975 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:11:55.590467 tst mo_mt_call_osmux.py: using LAC 31221 20:11:55.723363 tst mo_mt_call_osmux.py: using RAC 111 20:11:55.850694 tst mo_mt_call_osmux.py: using CellId 31221 20:11:55.990540 tst mo_mt_call_osmux.py: using BVCI 31222 20:11:56.111369 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:56.123299 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:56.134984 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:56.147063 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:56.159125 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:11:56.171170 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:11:56.292873 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:11:56.412131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:56.888175 run create_hlr_db(pid=22971): Launched 20:11:57.015836 bus /sierra_2: Setting Powered False 20:11:58.076650 run create_hlr_db(pid=22971): Terminated: ok {rc=0} 20:11:58.525720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22973): Launched 20:11:58.855740 run osmo-hlr_10.42.42.2(pid=22974): Launched 20:11:58.983635 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:59.555648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22976): Launched 20:11:59.886762 run osmo-stp_10.42.42.5(pid=22977): Launched 20:12:00.014194 run osmo-msc_10.42.42.6: Starting osmo-msc 20:12:00.610951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22979): Launched 20:12:00.969662 run osmo-msc_10.42.42.6(pid=22980): Launched 20:12:01.341928 run osmo-stp_10.42.42.5(pid=22977): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22977)] 20:12:01.672191 run osmo-stp_10.42.42.5(pid=22977): stdout: | (launched: 2022-12-12_20:11:59.825422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:01.972900 run osmo-stp_10.42.42.5(pid=22977): stderr: | 20221212201200020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201200020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201200020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201200021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201200021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201200021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201200021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:02.112750 run osmo-stp_10.42.42.5(pid=22977): stdout: | (launched: 2022-12-12_20:11:59.825422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:02.247508 run osmo-stp_10.42.42.5(pid=22977): stderr: | 20221212201200020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201200020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201200020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201200021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201200021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201200021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201200021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:02.408301 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22977): Process ended prematurely: osmo-stp_10.42.42.5(pid=22977) [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22977)] [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:12:02.418031 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 20:12:02.447202 run osmo-hlr_10.42.42.2(pid=22974): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22974)] 20:12:02.498798 run osmo-hlr_10.42.42.2(pid=22974): stdout: | (launched: 2022-12-12_20:11:58.794753) 20:12:02.552412 run osmo-hlr_10.42.42.2(pid=22974): stderr: | 20221212201158995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201158995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201158996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201158996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201158996 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201158996 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201159008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201159017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201159017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201159017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:02.626739 run osmo-msc_10.42.42.6(pid=22980): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22980)] 20:12:02.678234 run osmo-msc_10.42.42.6(pid=22980): stdout: | (launched: 2022-12-12_20:12:00.885191) 20:12:02.731670 run osmo-msc_10.42.42.6(pid=22980): stderr: | 20221212201201627 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201201628 DLGLOBAL DEBUG validating counter group 0x7f3685d1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201201629 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201201630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201201631 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201201633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201201636 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201201637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201201638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201201638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:12:02.785603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22973): Terminating (SIGTERM) 20:12:02.828457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22976): Terminating (SIGTERM) 20:12:02.871498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22979): Terminating (SIGTERM) 20:12:02.914745 --- ParallelTerminationStrategy: PID 22973 died... 20:12:02.934845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22973): Terminated: ok {rc=0} 20:12:02.982790 --- ParallelTerminationStrategy: PID 22976 died... 20:12:03.002799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22976): Terminated: ok {rc=0} 20:12:03.050652 --- ParallelTerminationStrategy: PID 22979 died... 20:12:03.070614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22979): Terminated: ok {rc=0} 20:12:03.160451 bus /sierra_3: Setting Powered False 20:12:04.261653 bus /sierra_3: Setting Powered False 20:12:05.379519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:nanobts+band-1900 --------------------------------------------------------------------- 20:12:06.625713 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:12:06.631567 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 20:12:06.657378 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 20:12:06.684702 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 20:12:06.771981 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 20:12:06.796624 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 20:12:06.824672 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 20:12:07.407677 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 20:12:07.413053 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:07.424149 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:12:07.468227 tst emergency_mo_mt_call.py: using LAC 31222 20:12:07.586898 tst emergency_mo_mt_call.py: using RAC 112 20:12:07.705165 tst emergency_mo_mt_call.py: using CellId 31222 20:12:07.821021 tst emergency_mo_mt_call.py: using BVCI 31223 20:12:07.929624 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:07.940335 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:07.951155 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:07.961892 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:07.972508 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:07.983179 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:08.101295 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:08.217071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:08.685745 run create_hlr_db(pid=22986): Launched 20:12:08.809366 bus /sierra_2: Setting Powered False 20:12:09.869541 run create_hlr_db(pid=22986): Terminated: ok {rc=0} 20:12:10.313990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22988): Launched 20:12:10.638588 run osmo-hlr_10.42.42.2(pid=22989): Launched 20:12:10.763704 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:11.321655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22991): Launched 20:12:11.646917 run osmo-stp_10.42.42.5(pid=22992): Launched 20:12:11.782990 tst emergency_mo_mt_call.py: using MSISDN 7944 20:12:11.951673 run osmo-msc_10.42.42.6: Starting osmo-msc 20:12:12.535453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22994): Launched 20:12:12.861558 run osmo-msc_10.42.42.6(pid=22995): Launched 20:12:13.044058 run osmo-stp_10.42.42.5(pid=22992): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22992)] 20:12:13.181127 run osmo-stp_10.42.42.5(pid=22992): stdout: | (launched: 2022-12-12_20:12:11.586643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:13.318625 run osmo-stp_10.42.42.5(pid=22992): stderr: | 20221212201211782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201211783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201211783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201211783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201211784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201211784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201211784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:13.455289 run osmo-stp_10.42.42.5(pid=22992): stdout: | (launched: 2022-12-12_20:12:11.586643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:13.584371 run osmo-stp_10.42.42.5(pid=22992): stderr: | 20221212201211782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201211783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201211783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201211783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201211784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201211784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201211784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:13.738749 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22992): Process ended prematurely: osmo-stp_10.42.42.5(pid=22992) [trial-2381↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22992)] [trial-2381↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 20:12:13.747867 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 20:12:13.776243 run osmo-hlr_10.42.42.2(pid=22989): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22989)] 20:12:13.827032 run osmo-hlr_10.42.42.2(pid=22989): stdout: | (launched: 2022-12-12_20:12:10.578414) 20:12:13.879520 run osmo-hlr_10.42.42.2(pid=22989): stderr: | 20221212201210778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201210778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201210778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201210778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201210778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201210778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201210791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201210799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201210800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201210800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:13.953266 run osmo-msc_10.42.42.6(pid=22995): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22995)] 20:12:14.004483 run osmo-msc_10.42.42.6(pid=22995): stdout: | (launched: 2022-12-12_20:12:12.800803) 20:12:14.057269 run osmo-msc_10.42.42.6(pid=22995): stderr: | 20221212201213124 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201213124 DLGLOBAL DEBUG validating counter group 0x7f3f280adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201213125 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201213125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201213125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201213125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201213127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201213127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201213127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201213127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:12:14.110358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22988): Terminating (SIGTERM) 20:12:14.152714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22991): Terminating (SIGTERM) 20:12:14.195328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22994): Terminating (SIGTERM) 20:12:14.238078 --- ParallelTerminationStrategy: PID 22988 died... 20:12:14.258331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22988): Terminated: ok {rc=0} 20:12:14.305595 --- ParallelTerminationStrategy: PID 22991 died... 20:12:14.325510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22991): Terminated: ok {rc=0} 20:12:14.372390 --- ParallelTerminationStrategy: PID 22994 died... 20:12:14.392088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22994): Terminated: ok {rc=0} 20:12:14.481301 bus /sierra_3: Setting Powered False 20:12:15.583081 bus /sierra_3: Setting Powered False 20:12:16.711726 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 20:12:17.808181 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:17.819789 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:12:17.864364 tst emergency_preemptive_call.py: using LAC 31223 20:12:17.981441 tst emergency_preemptive_call.py: using RAC 113 20:12:18.100387 tst emergency_preemptive_call.py: using CellId 31223 20:12:18.230795 tst emergency_preemptive_call.py: using BVCI 31224 20:12:18.348688 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:18.360724 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:18.372053 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:18.383528 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:18.395051 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 20:12:18.406678 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:18.524104 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:18.645074 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:18.760539 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:18.878376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:19.382633 run create_hlr_db(pid=22997): Launched 20:12:19.507232 bus /sierra_2: Setting Powered False 20:12:20.571189 run create_hlr_db(pid=22997): Terminated: ok {rc=0} 20:12:21.005585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22999): Launched 20:12:21.310231 run osmo-hlr_10.42.42.2(pid=23000): Launched 20:12:21.428675 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:21.951438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23002): Launched 20:12:22.256838 run osmo-stp_10.42.42.5(pid=23003): Launched 20:12:22.383999 tst emergency_preemptive_call.py: using MSISDN 7945 20:12:22.537252 run osmo-msc_10.42.42.6: Starting osmo-msc 20:12:23.081758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23005): Launched 20:12:23.385318 run osmo-msc_10.42.42.6(pid=23006): Launched 20:12:23.555228 run osmo-stp_10.42.42.5(pid=23003): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23003)] 20:12:23.682708 run osmo-stp_10.42.42.5(pid=23003): stdout: | (launched: 2022-12-12_20:12:22.199891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:23.809883 run osmo-stp_10.42.42.5(pid=23003): stderr: | 20221212201222373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201222373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201222373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201222373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201222374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201222374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201222374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:23.935562 run osmo-stp_10.42.42.5(pid=23003): stdout: | (launched: 2022-12-12_20:12:22.199891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:24.055688 run osmo-stp_10.42.42.5(pid=23003): stderr: | 20221212201222373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201222373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201222373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201222373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201222374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201222374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201222374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:24.199370 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23003): Process ended prematurely: osmo-stp_10.42.42.5(pid=23003) [trial-2381↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23003)] [trial-2381↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 20:12:24.207895 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 20:12:24.234739 run osmo-hlr_10.42.42.2(pid=23000): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23000)] 20:12:24.283184 run osmo-hlr_10.42.42.2(pid=23000): stdout: | (launched: 2022-12-12_20:12:21.253224) 20:12:24.333366 run osmo-hlr_10.42.42.2(pid=23000): stderr: | 20221212201221432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201221432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201221433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201221433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201221433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201221433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201221448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201221457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201221457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201221457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:24.403373 run osmo-msc_10.42.42.6(pid=23006): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23006)] 20:12:24.451669 run osmo-msc_10.42.42.6(pid=23006): stdout: | (launched: 2022-12-12_20:12:23.328253) 20:12:24.501408 run osmo-msc_10.42.42.6(pid=23006): stderr: | 20221212201223602 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201223603 DLGLOBAL DEBUG validating counter group 0x7f9595d91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201223603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201223603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201223603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201223603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201223605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201223606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201223606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201223606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:12:24.551658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22999): Terminating (SIGTERM) 20:12:24.591604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23002): Terminating (SIGTERM) 20:12:24.631596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23005): Terminating (SIGTERM) 20:12:24.671795 --- ParallelTerminationStrategy: PID 22999 died... 20:12:24.691020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22999): Terminated: ok {rc=0} 20:12:24.736134 --- ParallelTerminationStrategy: PID 23002 died... 20:12:24.755542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23002): Terminated: ok {rc=0} 20:12:24.800425 --- ParallelTerminationStrategy: PID 23005 died... 20:12:24.819437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23005): Terminated: ok {rc=0} 20:12:24.907091 bus /sierra_9: Setting Powered False 20:12:26.009459 bus /sierra_9: Setting Powered False 20:12:27.127331 bus /sierra_8: Setting Powered False 20:12:28.227458 bus /sierra_8: Setting Powered False 20:12:29.345643 bus /sierra_3: Setting Powered False 20:12:30.444629 bus /sierra_3: Setting Powered False 20:12:31.558179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-1900 --------------------------------------------------------------------- 20:12:32.827592 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:12:32.832880 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 20:12:32.857339 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 20:12:32.896053 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 20:12:32.984132 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 20:12:33.007819 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 20:12:33.046076 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 20:12:33.637457 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 20:12:33.687783 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:33.698688 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:12:33.737972 tst cs_paging_gprs_active.py: using LAC 31224 20:12:33.859884 tst cs_paging_gprs_active.py: using RAC 114 20:12:33.981657 tst cs_paging_gprs_active.py: using CellId 31224 20:12:34.101384 tst cs_paging_gprs_active.py: using BVCI 31225 20:12:34.212374 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.223311 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.234045 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.244631 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.255305 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.265868 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.277160 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.287691 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:34.298475 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:34.419795 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:34.542633 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:12:34.765866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:35.099276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23011): Launched 20:12:35.389712 run iperf3-srv_10.42.42.10(pid=23012): Launched 20:12:35.514747 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:12:35.738111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:36.072021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23013): Launched 20:12:36.363332 run iperf3-srv_10.42.42.10(pid=23014): Launched 20:12:36.487946 tst cs_paging_gprs_active.py:38: start network... 20:12:36.711116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:37.225397 run create_hlr_db(pid=23015): Launched 20:12:37.353951 bus /sierra_2: Setting Powered False 20:12:38.419564 run create_hlr_db(pid=23015): Terminated: ok {rc=0} 20:12:38.863085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23017): Launched 20:12:39.174155 run osmo-hlr_10.42.42.2(pid=23018): Launched 20:12:39.294634 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:39.827170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23020): Launched 20:12:40.139488 run osmo-stp_10.42.42.5(pid=23021): Launched 20:12:40.257022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:40.791147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23023): Launched 20:12:40.911058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:41.173585 run patchelf(pid=23024): Launched 20:12:41.345994 run osmo-stp_10.42.42.5(pid=23021): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23021)] 20:12:41.476520 run osmo-stp_10.42.42.5(pid=23021): stdout: | (launched: 2022-12-12_20:12:40.080915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:41.609456 run osmo-stp_10.42.42.5(pid=23021): stderr: | 20221212201240255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201240255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201240256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201240256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201240257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201240257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201240257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:41.742665 run osmo-stp_10.42.42.5(pid=23021): stdout: | (launched: 2022-12-12_20:12:40.080915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:41.868597 run osmo-stp_10.42.42.5(pid=23021): stderr: | 20221212201240255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201240255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201240256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201240256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201240257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201240257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201240257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:42.018543 run patchelf(pid=23024): Terminating (SIGINT) 20:12:42.191986 run patchelf(pid=23024): Terminated: ok {rc=0} 20:12:42.316557 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23021): Process ended prematurely: osmo-stp_10.42.42.5(pid=23021) [trial-2381↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23021)] [trial-2381↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 20:12:42.326095 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:12:42.353643 run osmo-hlr_10.42.42.2(pid=23018): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23018)] 20:12:42.401331 run osmo-hlr_10.42.42.2(pid=23018): stdout: | (launched: 2022-12-12_20:12:39.115991) 20:12:42.450965 run osmo-hlr_10.42.42.2(pid=23018): stderr: | 20221212201239298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201239298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201239298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201239298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201239298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201239298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201239315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201239325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201239326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201239326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:42.501178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23011): Terminating (SIGTERM) 20:12:42.541121 run iperf3-srv_10.42.42.10(pid=23012): Terminating (SIGTERM) 20:12:42.581149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23013): Terminating (SIGTERM) 20:12:42.621973 run iperf3-srv_10.42.42.10(pid=23014): Terminating (SIGTERM) 20:12:42.661977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23017): Terminating (SIGTERM) 20:12:42.702173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23020): Terminating (SIGTERM) 20:12:42.742047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23023): Terminating (SIGTERM) 20:12:42.782182 --- ParallelTerminationStrategy: PID 23011 died... 20:12:42.801496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23011): Terminated: ok {rc=0} 20:12:42.845922 --- ParallelTerminationStrategy: PID 23012 died... 20:12:42.864407 run iperf3-srv_10.42.42.10(pid=23012): Terminated {rc=256} 20:12:42.908565 --- ParallelTerminationStrategy: PID 23013 died... 20:12:42.927328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23013): Terminated: ok {rc=0} 20:12:42.971352 --- ParallelTerminationStrategy: PID 23014 died... 20:12:42.990074 run iperf3-srv_10.42.42.10(pid=23014): Terminated {rc=256} 20:12:43.034593 --- ParallelTerminationStrategy: PID 23017 died... 20:12:43.053383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23017): Terminated: ok {rc=0} 20:12:43.097469 --- ParallelTerminationStrategy: PID 23020 died... 20:12:43.116008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23020): Terminated: ok {rc=0} 20:12:43.160456 --- ParallelTerminationStrategy: PID 23023 died... 20:12:43.179248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23023): Terminated: ok {rc=0} 20:12:43.263688 bus /gobi_0: Setting Powered False 20:12:44.363178 bus /gobi_0: Setting Powered False 20:12:45.482188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 20:12:46.669539 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:46.682261 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:12:46.724411 tst iperf3.py: using LAC 31225 20:12:46.851039 tst iperf3.py: using RAC 115 20:12:46.983700 tst iperf3.py: using CellId 31225 20:12:47.106409 tst iperf3.py: using BVCI 31226 20:12:47.220362 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.231792 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.243190 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.253949 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.264494 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.275124 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.286012 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.296778 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:47.307607 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:47.426074 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:12:47.631462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:47.941681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23025): Launched 20:12:48.211089 run iperf3-srv_10.42.42.10(pid=23026): Launched 20:12:48.328129 tst iperf3.py:8: start network... 20:12:48.533114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:49.010407 run create_hlr_db(pid=23027): Launched 20:12:49.137795 bus /gobi_6: Setting Powered False 20:12:50.199272 run create_hlr_db(pid=23027): Terminated: ok {rc=0} 20:12:50.651054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23029): Launched 20:12:50.982997 run osmo-hlr_10.42.42.2(pid=23030): Launched 20:12:51.110733 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:51.678054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23032): Launched 20:12:52.036391 run osmo-stp_10.42.42.5(pid=23033): Launched 20:12:52.163959 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:52.735359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23035): Launched 20:12:52.861863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:53.143183 run patchelf(pid=23036): Launched 20:12:53.328741 run osmo-stp_10.42.42.5(pid=23033): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23033)] 20:12:53.468391 run osmo-stp_10.42.42.5(pid=23033): stdout: | (launched: 2022-12-12_20:12:51.974771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:53.610146 run osmo-stp_10.42.42.5(pid=23033): stderr: | 20221212201252172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201252173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201252173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201252173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201252174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201252174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201252174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:53.752021 run osmo-stp_10.42.42.5(pid=23033): stdout: | (launched: 2022-12-12_20:12:51.974771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:53.887840 run osmo-stp_10.42.42.5(pid=23033): stderr: | 20221212201252172 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201252173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201252173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201252173 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201252174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201252174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201252174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:54.048812 run patchelf(pid=23036): Terminating (SIGINT) 20:12:54.233894 run patchelf(pid=23036): Terminated: ok {rc=0} 20:12:54.367801 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23033): Process ended prematurely: osmo-stp_10.42.42.5(pid=23033) [trial-2381↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23033)] [trial-2381↪gprs:nanobts+band-1900↪iperf3.py:8] 20:12:54.378262 tst iperf3.py:8: Test FAILED (7.8 sec) 20:12:54.408097 run osmo-hlr_10.42.42.2(pid=23030): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23030)] 20:12:54.459361 run osmo-hlr_10.42.42.2(pid=23030): stdout: | (launched: 2022-12-12_20:12:50.921586) 20:12:54.512624 run osmo-hlr_10.42.42.2(pid=23030): stderr: | 20221212201251122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201251122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201251122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201251122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201251123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201251123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201251135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201251143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201251144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201251144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:54.566347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23025): Terminating (SIGTERM) 20:12:54.609170 run iperf3-srv_10.42.42.10(pid=23026): Terminating (SIGTERM) 20:12:54.651708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23029): Terminating (SIGTERM) 20:12:54.694329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23032): Terminating (SIGTERM) 20:12:54.737046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23035): Terminating (SIGTERM) 20:12:54.780050 --- ParallelTerminationStrategy: PID 23025 died... 20:12:54.800496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23025): Terminated: ok {rc=0} 20:12:54.848171 --- ParallelTerminationStrategy: PID 23026 died... 20:12:54.868381 run iperf3-srv_10.42.42.10(pid=23026): Terminated {rc=256} 20:12:54.915951 --- ParallelTerminationStrategy: PID 23029 died... 20:12:54.935816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23029): Terminated: ok {rc=0} 20:12:54.983226 --- ParallelTerminationStrategy: PID 23032 died... 20:12:55.003463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23032): Terminated: ok {rc=0} 20:12:55.050958 --- ParallelTerminationStrategy: PID 23035 died... 20:12:55.070854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23035): Terminated: ok {rc=0} 20:12:55.160561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 20:12:56.314109 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.326089 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:12:56.367275 tst iperf3m4.py: using LAC 31226 20:12:56.498368 tst iperf3m4.py: using RAC 116 20:12:56.626724 tst iperf3m4.py: using CellId 31226 20:12:56.754097 tst iperf3m4.py: using BVCI 31227 20:12:56.867382 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.878344 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.889154 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.900574 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.911760 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.922880 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.934313 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.945452 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:12:56.957174 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:57.077578 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:57.200349 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:57.318732 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:12:57.438565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:12:57.661878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:57.996886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23037): Launched 20:12:58.288118 run iperf3-srv_10.42.42.10(pid=23038): Launched 20:12:58.414521 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:12:58.635796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:58.968750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23039): Launched 20:12:59.260473 run iperf3-srv_10.42.42.10(pid=23040): Launched 20:12:59.386384 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:12:59.608327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:59.941781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23041): Launched 20:13:00.231609 run iperf3-srv_10.42.42.10(pid=23042): Launched 20:13:00.357343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:13:00.579055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:00.935441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23043): Launched 20:13:01.246119 run iperf3-srv_10.42.42.10(pid=23044): Launched 20:13:01.384938 tst iperf3m4.py:8: start network... 20:13:01.611152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:02.134685 run create_hlr_db(pid=23045): Launched 20:13:02.276451 bus /gobi_6: Setting Powered False 20:13:03.341958 run create_hlr_db(pid=23045): Terminated: ok {rc=0} 20:13:03.783011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23047): Launched 20:13:04.096162 run osmo-hlr_10.42.42.2(pid=23048): Launched 20:13:04.214588 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:04.747852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23050): Launched 20:13:05.059345 run osmo-stp_10.42.42.5(pid=23051): Launched 20:13:05.179246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:05.712020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23053): Launched 20:13:05.829894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:06.092142 run patchelf(pid=23054): Launched 20:13:06.278709 run osmo-stp_10.42.42.5(pid=23051): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23051)] 20:13:06.419513 run osmo-stp_10.42.42.5(pid=23051): stdout: | (launched: 2022-12-12_20:13:05.001170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:06.561422 run osmo-stp_10.42.42.5(pid=23051): stderr: | 20221212201305173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201305174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201305174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201305174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201305175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201305175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201305175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:06.704021 run osmo-stp_10.42.42.5(pid=23051): stdout: | (launched: 2022-12-12_20:13:05.001170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:06.839566 run osmo-stp_10.42.42.5(pid=23051): stderr: | 20221212201305173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201305174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201305174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201305174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201305175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201305175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201305175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:07.000539 run patchelf(pid=23054): Terminating (SIGINT) 20:13:07.186183 run patchelf(pid=23054): Terminated: ok {rc=0} 20:13:07.320022 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23051): Process ended prematurely: osmo-stp_10.42.42.5(pid=23051) [trial-2381↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23051)] [trial-2381↪gprs:nanobts+band-1900↪iperf3m4.py:8] 20:13:07.330571 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:13:07.360580 run osmo-hlr_10.42.42.2(pid=23048): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23048)] 20:13:07.411988 run osmo-hlr_10.42.42.2(pid=23048): stdout: | (launched: 2022-12-12_20:13:04.037813) 20:13:07.465244 run osmo-hlr_10.42.42.2(pid=23048): stderr: | 20221212201304214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201304215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201304215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201304215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201304215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201304215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201304227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201304235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201304235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201304236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:07.518988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23037): Terminating (SIGTERM) 20:13:07.562157 run iperf3-srv_10.42.42.10(pid=23038): Terminating (SIGTERM) 20:13:07.605057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23039): Terminating (SIGTERM) 20:13:07.647974 run iperf3-srv_10.42.42.10(pid=23040): Terminating (SIGTERM) 20:13:07.690959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23041): Terminating (SIGTERM) 20:13:07.733965 run iperf3-srv_10.42.42.10(pid=23042): Terminating (SIGTERM) 20:13:07.776738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23043): Terminating (SIGTERM) 20:13:07.819813 run iperf3-srv_10.42.42.10(pid=23044): Terminating (SIGTERM) 20:13:07.862638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23047): Terminating (SIGTERM) 20:13:07.905774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23050): Terminating (SIGTERM) 20:13:07.948727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23053): Terminating (SIGTERM) 20:13:07.991975 --- ParallelTerminationStrategy: PID 23037 died... 20:13:08.013060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23037): Terminated: ok {rc=0} 20:13:08.061248 --- ParallelTerminationStrategy: PID 23038 died... 20:13:08.081366 run iperf3-srv_10.42.42.10(pid=23038): Terminated {rc=256} 20:13:08.129196 --- ParallelTerminationStrategy: PID 23039 died... 20:13:08.149322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23039): Terminated: ok {rc=0} 20:13:08.197218 --- ParallelTerminationStrategy: PID 23040 died... 20:13:08.217151 run iperf3-srv_10.42.42.10(pid=23040): Terminated {rc=256} 20:13:08.264657 --- ParallelTerminationStrategy: PID 23041 died... 20:13:08.284778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23041): Terminated: ok {rc=0} 20:13:08.332937 --- ParallelTerminationStrategy: PID 23042 died... 20:13:08.353107 run iperf3-srv_10.42.42.10(pid=23042): Terminated {rc=256} 20:13:08.401146 --- ParallelTerminationStrategy: PID 23043 died... 20:13:08.421388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23043): Terminated: ok {rc=0} 20:13:08.469746 --- ParallelTerminationStrategy: PID 23044 died... 20:13:08.489967 run iperf3-srv_10.42.42.10(pid=23044): Terminated {rc=256} 20:13:08.538023 --- ParallelTerminationStrategy: PID 23047 died... 20:13:08.558162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23047): Terminated: ok {rc=0} 20:13:08.605994 --- ParallelTerminationStrategy: PID 23050 died... 20:13:08.626544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23050): Terminated: ok {rc=0} 20:13:08.674592 --- ParallelTerminationStrategy: PID 23053 died... 20:13:08.694800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23053): Terminated: ok {rc=0} 20:13:08.784168 bus /gobi_4: Setting Powered False 20:13:09.886775 bus /gobi_4: Setting Powered False 20:13:11.006596 bus /gobi_1: Setting Powered False 20:13:12.106271 bus /gobi_1: Setting Powered False 20:13:13.225494 bus /gobi_0: Setting Powered False 20:13:14.325187 bus /gobi_0: Setting Powered False 20:13:15.444596 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 20:13:16.562860 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:16.580797 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:13:16.634938 tst ping.py: using LAC 31227 20:13:16.764435 tst ping.py: using RAC 117 20:13:16.919414 tst ping.py: using CellId 31227 20:13:17.041869 tst ping.py: using BVCI 31228 20:13:17.153918 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:17.165891 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:17.177830 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:17.190004 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:17.201816 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:17.213597 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:17.225540 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:17.237548 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:13:17.355633 tst ping.py:19: start network... 20:13:17.557447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:18.025679 run create_hlr_db(pid=23055): Launched 20:13:18.150474 bus /gobi_6: Setting Powered False 20:13:19.211471 run create_hlr_db(pid=23055): Terminated: ok {rc=0} 20:13:19.654553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23057): Launched 20:13:19.979407 run osmo-hlr_10.42.42.2(pid=23058): Launched 20:13:20.106076 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:20.682636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23060): Launched 20:13:21.007997 run osmo-stp_10.42.42.5(pid=23061): Launched 20:13:21.134224 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:21.700491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23063): Launched 20:13:21.824850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:22.101092 run patchelf(pid=23064): Launched 20:13:22.281512 run osmo-stp_10.42.42.5(pid=23061): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23061)] 20:13:22.419241 run osmo-stp_10.42.42.5(pid=23061): stdout: | (launched: 2022-12-12_20:13:20.947505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:22.558489 run osmo-stp_10.42.42.5(pid=23061): stderr: | 20221212201321145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201321145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201321145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201321146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201321146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201321146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201321146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:22.697823 run osmo-stp_10.42.42.5(pid=23061): stdout: | (launched: 2022-12-12_20:13:20.947505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:22.831129 run osmo-stp_10.42.42.5(pid=23061): stderr: | 20221212201321145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201321145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201321145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201321146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201321146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201321146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201321146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:22.988629 run patchelf(pid=23064): Terminating (SIGINT) 20:13:23.170598 run patchelf(pid=23064): Terminated: ok {rc=0} 20:13:23.300738 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23061): Process ended prematurely: osmo-stp_10.42.42.5(pid=23061) [trial-2381↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23061)] [trial-2381↪gprs:nanobts+band-1900↪ping.py:22] 20:13:23.310741 tst ping.py:22: Test FAILED (6.7 sec) 20:13:23.340037 run osmo-hlr_10.42.42.2(pid=23058): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23058)] 20:13:23.391616 run osmo-hlr_10.42.42.2(pid=23058): stdout: | (launched: 2022-12-12_20:13:19.918959) 20:13:23.444890 run osmo-hlr_10.42.42.2(pid=23058): stderr: | 20221212201320121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201320121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201320121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201320121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201320122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201320122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201320138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201320148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201320148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201320148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:23.498542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23057): Terminating (SIGTERM) 20:13:23.541530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23060): Terminating (SIGTERM) 20:13:23.584740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23063): Terminating (SIGTERM) 20:13:23.628114 --- ParallelTerminationStrategy: PID 23057 died... 20:13:23.648829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23057): Terminated: ok {rc=0} 20:13:23.697120 --- ParallelTerminationStrategy: PID 23060 died... 20:13:23.717409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23060): Terminated: ok {rc=0} 20:13:23.765291 --- ParallelTerminationStrategy: PID 23063 died... 20:13:23.785357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23063): Terminated: ok {rc=0} 20:13:23.875705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 20:13:24.964757 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:24.977098 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 20:13:25.022685 tst ping_idle_ping.py: using LAC 31228 20:13:25.149447 tst ping_idle_ping.py: using RAC 118 20:13:25.267257 tst ping_idle_ping.py: using CellId 31228 20:13:25.384842 tst ping_idle_ping.py: using BVCI 31229 20:13:25.494164 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:25.505057 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:25.515704 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:25.526542 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:25.537130 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:25.547667 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:25.558557 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 20:13:25.569381 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 20:13:25.688038 tst ping_idle_ping.py:24: start network... 20:13:25.892392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:26.368687 run create_hlr_db(pid=23065): Launched 20:13:26.492243 bus /gobi_6: Setting Powered False 20:13:27.552785 run create_hlr_db(pid=23065): Terminated: ok {rc=0} 20:13:27.999369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23067): Launched 20:13:28.327834 run osmo-hlr_10.42.42.2(pid=23068): Launched 20:13:28.453872 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:29.018461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23070): Launched 20:13:29.345912 run osmo-stp_10.42.42.5(pid=23071): Launched 20:13:29.471382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:30.035164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23073): Launched 20:13:30.159687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:30.436335 run patchelf(pid=23074): Launched 20:13:30.619182 run osmo-stp_10.42.42.5(pid=23071): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23071)] 20:13:30.756457 run osmo-stp_10.42.42.5(pid=23071): stdout: | (launched: 2022-12-12_20:13:29.284686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:30.906146 run osmo-stp_10.42.42.5(pid=23071): stderr: | 20221212201329478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201329478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201329478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201329478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201329479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201329479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201329479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:31.040029 run osmo-stp_10.42.42.5(pid=23071): stdout: | (launched: 2022-12-12_20:13:29.284686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:31.169980 run osmo-stp_10.42.42.5(pid=23071): stderr: | 20221212201329478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201329478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201329478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201329478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201329479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201329479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201329479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:31.326856 run patchelf(pid=23074): Terminating (SIGINT) 20:13:31.545229 run patchelf(pid=23074): Terminated: ok {rc=0} 20:13:31.673730 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23071): Process ended prematurely: osmo-stp_10.42.42.5(pid=23071) [trial-2381↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23071)] [trial-2381↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 20:13:31.683810 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:13:31.713417 run osmo-hlr_10.42.42.2(pid=23068): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23068)] 20:13:31.762812 run osmo-hlr_10.42.42.2(pid=23068): stdout: | (launched: 2022-12-12_20:13:28.267195) 20:13:31.814056 run osmo-hlr_10.42.42.2(pid=23068): stderr: | 20221212201328468 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201328468 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201328468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201328468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201328469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201328469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201328481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201328489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201328489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201328489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:31.866741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23067): Terminating (SIGTERM) 20:13:31.912677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23070): Terminating (SIGTERM) 20:13:31.955056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23073): Terminating (SIGTERM) 20:13:31.999933 --- ParallelTerminationStrategy: PID 23067 died... 20:13:32.020371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23067): Terminated: ok {rc=0} 20:13:32.067373 --- ParallelTerminationStrategy: PID 23070 died... 20:13:32.088131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23070): Terminated: ok {rc=0} 20:13:32.135994 --- ParallelTerminationStrategy: PID 23073 died... 20:13:32.156222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23073): Terminated: ok {rc=0} 20:13:32.245769 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 20:13:33.548696 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:13:33.555732 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:13:33.581077 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:13:33.621725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:13:33.712291 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:13:33.736010 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:13:33.773924 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:13:34.367724 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:13:34.417220 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:34.428485 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:13:34.469355 tst cs_paging_gprs_active.py: using LAC 31229 20:13:34.591724 tst cs_paging_gprs_active.py: using RAC 119 20:13:34.713541 tst cs_paging_gprs_active.py: using CellId 31229 20:13:34.833951 tst cs_paging_gprs_active.py: using BVCI 31230 20:13:34.945434 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:34.956411 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:34.967308 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:34.978206 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:34.988901 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:34.999761 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:35.010801 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:35.021606 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:35.032620 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:13:35.149316 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:13:35.271842 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:13:35.495861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:35.828338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23078): Launched 20:13:36.120201 run iperf3-srv_10.42.42.10(pid=23079): Launched 20:13:36.246185 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:13:36.469303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:36.802636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23080): Launched 20:13:37.093876 run iperf3-srv_10.42.42.10(pid=23081): Launched 20:13:37.219639 tst cs_paging_gprs_active.py:38: start network... 20:13:37.442254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:37.954177 run create_hlr_db(pid=23082): Launched 20:13:38.084326 bus /gobi_6: Setting Powered False 20:13:39.150108 run create_hlr_db(pid=23082): Terminated: ok {rc=0} 20:13:39.593659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23084): Launched 20:13:39.904355 run osmo-hlr_10.42.42.2(pid=23085): Launched 20:13:40.021860 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:40.553865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23087): Launched 20:13:40.865505 run osmo-stp_10.42.42.5(pid=23088): Launched 20:13:40.983182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:41.514965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23090): Launched 20:13:41.635170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:41.897083 run patchelf(pid=23091): Launched 20:13:42.069733 run osmo-stp_10.42.42.5(pid=23088): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23088)] 20:13:42.201758 run osmo-stp_10.42.42.5(pid=23088): stdout: | (launched: 2022-12-12_20:13:40.807463) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:42.334486 run osmo-stp_10.42.42.5(pid=23088): stderr: | 20221212201340983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201340983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201340983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201340983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201340984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201340984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201340984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:42.466684 run osmo-stp_10.42.42.5(pid=23088): stdout: | (launched: 2022-12-12_20:13:40.807463) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:42.592896 run osmo-stp_10.42.42.5(pid=23088): stderr: | 20221212201340983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201340983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201340983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201340983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201340984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201340984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201340984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:42.742564 run patchelf(pid=23091): Terminating (SIGINT) 20:13:42.915495 run patchelf(pid=23091): Terminated: ok {rc=0} 20:13:43.040232 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23088): Process ended prematurely: osmo-stp_10.42.42.5(pid=23088) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23088)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:13:43.050020 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:13:43.077638 run osmo-hlr_10.42.42.2(pid=23085): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23085)] 20:13:43.125764 run osmo-hlr_10.42.42.2(pid=23085): stdout: | (launched: 2022-12-12_20:13:39.846963) 20:13:43.175444 run osmo-hlr_10.42.42.2(pid=23085): stderr: | 20221212201340025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201340025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201340025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201340025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201340025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201340026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201340041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201340051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201340052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201340052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:43.225695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23078): Terminating (SIGTERM) 20:13:43.265692 run iperf3-srv_10.42.42.10(pid=23079): Terminating (SIGTERM) 20:13:43.305574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23080): Terminating (SIGTERM) 20:13:43.345690 run iperf3-srv_10.42.42.10(pid=23081): Terminating (SIGTERM) 20:13:43.385420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23084): Terminating (SIGTERM) 20:13:43.425399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23087): Terminating (SIGTERM) 20:13:43.465347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23090): Terminating (SIGTERM) 20:13:43.505575 --- ParallelTerminationStrategy: PID 23078 died... 20:13:43.524849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23078): Terminated: ok {rc=0} 20:13:43.569319 --- ParallelTerminationStrategy: PID 23079 died... 20:13:43.588096 run iperf3-srv_10.42.42.10(pid=23079): Terminated {rc=256} 20:13:43.632091 --- ParallelTerminationStrategy: PID 23080 died... 20:13:43.650877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23080): Terminated: ok {rc=0} 20:13:43.695051 --- ParallelTerminationStrategy: PID 23081 died... 20:13:43.713811 run iperf3-srv_10.42.42.10(pid=23081): Terminated {rc=256} 20:13:43.757773 --- ParallelTerminationStrategy: PID 23084 died... 20:13:43.776521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23084): Terminated: ok {rc=0} 20:13:43.820733 --- ParallelTerminationStrategy: PID 23087 died... 20:13:43.839635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23087): Terminated: ok {rc=0} 20:13:43.884317 --- ParallelTerminationStrategy: PID 23090 died... 20:13:43.903343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23090): Terminated: ok {rc=0} 20:13:43.991386 bus /gobi_0: Setting Powered False 20:13:45.093465 bus /gobi_0: Setting Powered False 20:13:46.213249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:13:47.377376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.389586 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:13:47.434202 tst iperf3.py: using LAC 31230 20:13:47.564900 tst iperf3.py: using RAC 120 20:13:47.685362 tst iperf3.py: using CellId 31230 20:13:47.805941 tst iperf3.py: using BVCI 31231 20:13:47.917277 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.928260 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.939219 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.950136 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.961354 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.971992 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.982977 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:47.993978 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:48.004852 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:13:48.124713 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:13:48.350154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:48.686494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23092): Launched 20:13:48.980002 run iperf3-srv_10.42.42.10(pid=23093): Launched 20:13:49.108122 tst iperf3.py:8: start network... 20:13:49.332282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:49.846552 run create_hlr_db(pid=23094): Launched 20:13:49.972905 bus /gobi_6: Setting Powered False 20:13:51.038817 run create_hlr_db(pid=23094): Terminated: ok {rc=0} 20:13:51.482622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23096): Launched 20:13:51.794908 run osmo-hlr_10.42.42.2(pid=23097): Launched 20:13:51.914858 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:52.450394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23099): Launched 20:13:52.761423 run osmo-stp_10.42.42.5(pid=23100): Launched 20:13:52.880668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:53.412557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23102): Launched 20:13:53.531853 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:53.792861 run patchelf(pid=23103): Launched 20:13:53.966187 run osmo-stp_10.42.42.5(pid=23100): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23100)] 20:13:54.096640 run osmo-stp_10.42.42.5(pid=23100): stdout: | (launched: 2022-12-12_20:13:52.703191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:54.228696 run osmo-stp_10.42.42.5(pid=23100): stderr: | 20221212201352876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201352876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201352876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201352876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201352877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201352877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201352877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:54.362333 run osmo-stp_10.42.42.5(pid=23100): stdout: | (launched: 2022-12-12_20:13:52.703191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:54.488047 run osmo-stp_10.42.42.5(pid=23100): stderr: | 20221212201352876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201352876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201352876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201352876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201352877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201352877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201352877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:54.637895 run patchelf(pid=23103): Terminating (SIGINT) 20:13:54.810242 run patchelf(pid=23103): Terminated: ok {rc=0} 20:13:54.934784 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23100): Process ended prematurely: osmo-stp_10.42.42.5(pid=23100) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23100)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 20:13:54.944277 tst iperf3.py:8: Test FAILED (7.6 sec) 20:13:54.971865 run osmo-hlr_10.42.42.2(pid=23097): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23097)] 20:13:55.020010 run osmo-hlr_10.42.42.2(pid=23097): stdout: | (launched: 2022-12-12_20:13:51.736642) 20:13:55.069907 run osmo-hlr_10.42.42.2(pid=23097): stderr: | 20221212201351918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201351919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201351919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201351919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201351919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201351919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201351931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201351940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201351940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201351940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:55.120271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23092): Terminating (SIGTERM) 20:13:55.160292 run iperf3-srv_10.42.42.10(pid=23093): Terminating (SIGTERM) 20:13:55.200203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23096): Terminating (SIGTERM) 20:13:55.240225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23099): Terminating (SIGTERM) 20:13:55.280040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23102): Terminating (SIGTERM) 20:13:55.320224 --- ParallelTerminationStrategy: PID 23092 died... 20:13:55.339599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23092): Terminated: ok {rc=0} 20:13:55.383866 --- ParallelTerminationStrategy: PID 23093 died... 20:13:55.402780 run iperf3-srv_10.42.42.10(pid=23093): Terminated {rc=256} 20:13:55.446971 --- ParallelTerminationStrategy: PID 23096 died... 20:13:55.465741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23096): Terminated: ok {rc=0} 20:13:55.509774 --- ParallelTerminationStrategy: PID 23099 died... 20:13:55.528482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23099): Terminated: ok {rc=0} 20:13:55.572528 --- ParallelTerminationStrategy: PID 23102 died... 20:13:55.591339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23102): Terminated: ok {rc=0} 20:13:55.677867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:13:56.827538 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:56.839170 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:13:56.880470 tst iperf3m4.py: using LAC 31231 20:13:57.007997 tst iperf3m4.py: using RAC 121 20:13:57.135468 tst iperf3m4.py: using CellId 31231 20:13:57.264361 tst iperf3m4.py: using BVCI 31232 20:13:57.376081 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.387200 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.398264 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.409113 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.419799 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.430495 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.441455 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.452244 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:13:57.463165 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:13:57.580935 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:13:57.704117 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:13:57.822756 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:13:57.945680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:13:58.170521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:58.505357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23104): Launched 20:13:58.796728 run iperf3-srv_10.42.42.10(pid=23105): Launched 20:13:58.923116 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:13:59.147204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:59.482239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23106): Launched 20:13:59.774601 run iperf3-srv_10.42.42.10(pid=23107): Launched 20:13:59.901291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:14:00.125127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:00.459713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23108): Launched 20:14:00.749993 run iperf3-srv_10.42.42.10(pid=23109): Launched 20:14:00.877543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:14:01.094780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:01.421702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23110): Launched 20:14:01.791900 run iperf3-srv_10.42.42.10(pid=23111): Launched 20:14:01.934050 tst iperf3m4.py:8: start network... 20:14:02.164178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:02.653956 run create_hlr_db(pid=23112): Launched 20:14:02.782041 bus /gobi_6: Setting Powered False 20:14:03.843004 run create_hlr_db(pid=23112): Terminated: ok {rc=0} 20:14:04.296937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23114): Launched 20:14:04.629998 run osmo-hlr_10.42.42.2(pid=23115): Launched 20:14:04.758443 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:05.333999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23117): Launched 20:14:05.668002 run osmo-stp_10.42.42.5(pid=23118): Launched 20:14:05.795673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:06.368863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23120): Launched 20:14:06.496610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:06.777437 run patchelf(pid=23121): Launched 20:14:06.963386 run osmo-stp_10.42.42.5(pid=23118): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23118)] 20:14:07.104233 run osmo-stp_10.42.42.5(pid=23118): stdout: | (launched: 2022-12-12_20:14:05.606113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:07.246299 run osmo-stp_10.42.42.5(pid=23118): stderr: | 20221212201405799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201405799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201405800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201405800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201405801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201405801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201405801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:07.388403 run osmo-stp_10.42.42.5(pid=23118): stdout: | (launched: 2022-12-12_20:14:05.606113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:07.523988 run osmo-stp_10.42.42.5(pid=23118): stderr: | 20221212201405799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201405799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201405800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201405800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201405801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201405801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201405801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:07.684591 run patchelf(pid=23121): Terminating (SIGINT) 20:14:07.869495 run patchelf(pid=23121): Terminated: ok {rc=0} 20:14:08.003087 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23118): Process ended prematurely: osmo-stp_10.42.42.5(pid=23118) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23118)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 20:14:08.013446 tst iperf3m4.py:8: Test FAILED (11.2 sec) 20:14:08.043608 run osmo-hlr_10.42.42.2(pid=23115): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23115)] 20:14:08.094998 run osmo-hlr_10.42.42.2(pid=23115): stdout: | (launched: 2022-12-12_20:14:04.567804) 20:14:08.147829 run osmo-hlr_10.42.42.2(pid=23115): stderr: | 20221212201404770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201404770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201404770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201404770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201404771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201404771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201404784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201404794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201404794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201404794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:08.201383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23104): Terminating (SIGTERM) 20:14:08.243925 run iperf3-srv_10.42.42.10(pid=23105): Terminating (SIGTERM) 20:14:08.286396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23106): Terminating (SIGTERM) 20:14:08.329038 run iperf3-srv_10.42.42.10(pid=23107): Terminating (SIGTERM) 20:14:08.371719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23108): Terminating (SIGTERM) 20:14:08.414736 run iperf3-srv_10.42.42.10(pid=23109): Terminating (SIGTERM) 20:14:08.457286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23110): Terminating (SIGTERM) 20:14:08.499773 run iperf3-srv_10.42.42.10(pid=23111): Terminating (SIGTERM) 20:14:08.542134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23114): Terminating (SIGTERM) 20:14:08.584682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23117): Terminating (SIGTERM) 20:14:08.627302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23120): Terminating (SIGTERM) 20:14:08.670228 --- ParallelTerminationStrategy: PID 23104 died... 20:14:08.690661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23104): Terminated: ok {rc=0} 20:14:08.738229 --- ParallelTerminationStrategy: PID 23105 died... 20:14:08.758017 run iperf3-srv_10.42.42.10(pid=23105): Terminated {rc=256} 20:14:08.805085 --- ParallelTerminationStrategy: PID 23106 died... 20:14:08.824908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23106): Terminated: ok {rc=0} 20:14:08.872278 --- ParallelTerminationStrategy: PID 23107 died... 20:14:08.892098 run iperf3-srv_10.42.42.10(pid=23107): Terminated {rc=256} 20:14:08.939057 --- ParallelTerminationStrategy: PID 23108 died... 20:14:08.958887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23108): Terminated: ok {rc=0} 20:14:09.006149 --- ParallelTerminationStrategy: PID 23109 died... 20:14:09.025876 run iperf3-srv_10.42.42.10(pid=23109): Terminated {rc=256} 20:14:09.073354 --- ParallelTerminationStrategy: PID 23110 died... 20:14:09.093458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23110): Terminated: ok {rc=0} 20:14:09.140569 --- ParallelTerminationStrategy: PID 23111 died... 20:14:09.160337 run iperf3-srv_10.42.42.10(pid=23111): Terminated {rc=256} 20:14:09.207471 --- ParallelTerminationStrategy: PID 23114 died... 20:14:09.227264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23114): Terminated: ok {rc=0} 20:14:09.274718 --- ParallelTerminationStrategy: PID 23117 died... 20:14:09.294590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23117): Terminated: ok {rc=0} 20:14:09.342323 --- ParallelTerminationStrategy: PID 23120 died... 20:14:09.362249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23120): Terminated: ok {rc=0} 20:14:09.451790 bus /gobi_4: Setting Powered False 20:14:10.552492 bus /gobi_4: Setting Powered False 20:14:11.670616 bus /gobi_1: Setting Powered False 20:14:12.769482 bus /gobi_1: Setting Powered False 20:14:13.886403 bus /gobi_0: Setting Powered False 20:14:14.983218 bus /gobi_0: Setting Powered False 20:14:16.104745 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 20:14:17.216274 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.229143 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:14:17.272845 tst ping.py: using LAC 31232 20:14:17.393479 tst ping.py: using RAC 122 20:14:17.512901 tst ping.py: using CellId 31232 20:14:17.632212 tst ping.py: using BVCI 31233 20:14:17.740771 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.751814 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.762793 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.773637 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.784323 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.795085 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.806204 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:17.817041 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:14:17.935289 tst ping.py:19: start network... 20:14:18.154257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:18.657136 run create_hlr_db(pid=23122): Launched 20:14:18.783409 bus /gobi_6: Setting Powered False 20:14:19.847216 run create_hlr_db(pid=23122): Terminated: ok {rc=0} 20:14:20.281620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23124): Launched 20:14:20.587730 run osmo-hlr_10.42.42.2(pid=23125): Launched 20:14:20.705348 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:21.247174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23127): Launched 20:14:21.551577 run osmo-stp_10.42.42.5(pid=23128): Launched 20:14:21.668824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:22.190914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23130): Launched 20:14:22.307826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:22.565854 run patchelf(pid=23131): Launched 20:14:22.736088 run osmo-stp_10.42.42.5(pid=23128): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23128)] 20:14:22.864004 run osmo-stp_10.42.42.5(pid=23128): stdout: | (launched: 2022-12-12_20:14:21.494811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:22.993787 run osmo-stp_10.42.42.5(pid=23128): stderr: | 20221212201421667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201421667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201421668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201421668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201421669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201421669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201421669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:23.124219 run osmo-stp_10.42.42.5(pid=23128): stdout: | (launched: 2022-12-12_20:14:21.494811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:23.247914 run osmo-stp_10.42.42.5(pid=23128): stderr: | 20221212201421667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201421667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201421668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201421668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201421669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201421669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201421669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:23.394039 run patchelf(pid=23131): Terminating (SIGINT) 20:14:23.562643 run patchelf(pid=23131): Terminated: ok {rc=0} 20:14:23.684402 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23128): Process ended prematurely: osmo-stp_10.42.42.5(pid=23128) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23128)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 20:14:23.693418 tst ping.py:22: Test FAILED (6.5 sec) 20:14:23.720641 run osmo-hlr_10.42.42.2(pid=23125): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23125)] 20:14:23.768765 run osmo-hlr_10.42.42.2(pid=23125): stdout: | (launched: 2022-12-12_20:14:20.530748) 20:14:23.818761 run osmo-hlr_10.42.42.2(pid=23125): stderr: | 20221212201420710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201420710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201420710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201420710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201420710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201420710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201420722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201420731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201420731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201420732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:23.869334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23124): Terminating (SIGTERM) 20:14:23.909176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23127): Terminating (SIGTERM) 20:14:23.949349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23130): Terminating (SIGTERM) 20:14:23.989624 --- ParallelTerminationStrategy: PID 23124 died... 20:14:24.008899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23124): Terminated: ok {rc=0} 20:14:24.053375 --- ParallelTerminationStrategy: PID 23127 died... 20:14:24.072064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23127): Terminated: ok {rc=0} 20:14:24.116602 --- ParallelTerminationStrategy: PID 23130 died... 20:14:24.135582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23130): Terminated: ok {rc=0} 20:14:24.222304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:14:25.313424 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.325654 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:14:25.368610 tst ping_idle_ping.py: using LAC 31233 20:14:25.489125 tst ping_idle_ping.py: using RAC 123 20:14:25.607675 tst ping_idle_ping.py: using CellId 31233 20:14:25.727840 tst ping_idle_ping.py: using BVCI 31234 20:14:25.837532 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.848671 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.859627 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.870613 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.881479 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.892259 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.903440 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:14:25.914343 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:14:26.031158 tst ping_idle_ping.py:24: start network... 20:14:26.235228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:26.715577 run create_hlr_db(pid=23132): Launched 20:14:26.842434 bus /gobi_6: Setting Powered False 20:14:27.903998 run create_hlr_db(pid=23132): Terminated: ok {rc=0} 20:14:28.353599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23134): Launched 20:14:28.683498 run osmo-hlr_10.42.42.2(pid=23135): Launched 20:14:28.809233 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:29.375978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23137): Launched 20:14:29.704894 run osmo-stp_10.42.42.5(pid=23138): Launched 20:14:29.830876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:30.395411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23140): Launched 20:14:30.521853 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:30.798466 run patchelf(pid=23141): Launched 20:14:30.999160 run osmo-stp_10.42.42.5(pid=23138): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23138)] 20:14:31.133559 run osmo-stp_10.42.42.5(pid=23138): stdout: | (launched: 2022-12-12_20:14:29.644477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:31.267034 run osmo-stp_10.42.42.5(pid=23138): stderr: | 20221212201429836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201429836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201429837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201429837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201429838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201429838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201429838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:31.402698 run osmo-stp_10.42.42.5(pid=23138): stdout: | (launched: 2022-12-12_20:14:29.644477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:31.531661 run osmo-stp_10.42.42.5(pid=23138): stderr: | 20221212201429836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201429836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201429837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201429837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201429838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201429838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201429838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:31.684681 run patchelf(pid=23141): Terminating (SIGINT) 20:14:31.860110 run patchelf(pid=23141): Terminated: ok {rc=0} 20:14:31.989179 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23138): Process ended prematurely: osmo-stp_10.42.42.5(pid=23138) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23138)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 20:14:31.999406 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:14:32.028302 run osmo-hlr_10.42.42.2(pid=23135): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23135)] 20:14:32.078129 run osmo-hlr_10.42.42.2(pid=23135): stdout: | (launched: 2022-12-12_20:14:28.622861) 20:14:32.131742 run osmo-hlr_10.42.42.2(pid=23135): stderr: | 20221212201428823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201428823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201428823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201428823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201428823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201428823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201428835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201428843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201428844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201428844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:32.184016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23134): Terminating (SIGTERM) 20:14:32.225289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23137): Terminating (SIGTERM) 20:14:32.265734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23140): Terminating (SIGTERM) 20:14:32.306462 --- ParallelTerminationStrategy: PID 23134 died... 20:14:32.326012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23134): Terminated: ok {rc=0} 20:14:32.371060 --- ParallelTerminationStrategy: PID 23137 died... 20:14:32.390068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23137): Terminated: ok {rc=0} 20:14:32.434636 --- ParallelTerminationStrategy: PID 23140 died... 20:14:32.453543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23140): Terminated: ok {rc=0} 20:14:32.541242 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:14:33.834779 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:33.841856 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:14:33.865514 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:14:33.904187 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:14:33.991366 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:14:34.014909 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:14:34.052936 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:14:34.649668 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:14:34.699703 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:34.710818 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:14:34.770689 tst cs_paging_gprs_active.py: using LAC 31234 20:14:34.890801 tst cs_paging_gprs_active.py: using RAC 124 20:14:35.012879 tst cs_paging_gprs_active.py: using CellId 31234 20:14:35.134602 tst cs_paging_gprs_active.py: using BVCI 31235 20:14:35.247393 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.258600 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.269713 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.280633 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.291560 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.302573 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.313698 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.324502 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:35.335723 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:14:35.456444 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:14:35.581329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:14:35.804828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:36.138586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23148): Launched 20:14:36.428387 run iperf3-srv_10.42.42.10(pid=23149): Launched 20:14:36.555680 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:14:36.779232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:37.112704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23150): Launched 20:14:37.403525 run iperf3-srv_10.42.42.10(pid=23151): Launched 20:14:37.529417 tst cs_paging_gprs_active.py:38: start network... 20:14:37.751470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:38.264149 run create_hlr_db(pid=23152): Launched 20:14:38.392699 bus /gobi_6: Setting Powered False 20:14:39.458077 run create_hlr_db(pid=23152): Terminated: ok {rc=0} 20:14:39.901943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23154): Launched 20:14:40.215323 run osmo-hlr_10.42.42.2(pid=23155): Launched 20:14:40.335126 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:40.873161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23157): Launched 20:14:41.184171 run osmo-stp_10.42.42.5(pid=23158): Launched 20:14:41.303630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:41.838565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23160): Launched 20:14:41.957679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:42.220314 run patchelf(pid=23161): Launched 20:14:42.394775 run osmo-stp_10.42.42.5(pid=23158): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23158)] 20:14:42.526244 run osmo-stp_10.42.42.5(pid=23158): stdout: | (launched: 2022-12-12_20:14:41.126157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:42.659712 run osmo-stp_10.42.42.5(pid=23158): stderr: | 20221212201441299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201441299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201441299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201441300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201441302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201441302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201441302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:42.792906 run osmo-stp_10.42.42.5(pid=23158): stdout: | (launched: 2022-12-12_20:14:41.126157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:42.919606 run osmo-stp_10.42.42.5(pid=23158): stderr: | 20221212201441299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201441299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201441299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201441300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201441302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201441302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201441302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:43.069873 run patchelf(pid=23161): Terminating (SIGINT) 20:14:43.243493 run patchelf(pid=23161): Terminated: ok {rc=0} 20:14:43.368393 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23158): Process ended prematurely: osmo-stp_10.42.42.5(pid=23158) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23158)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:14:43.378066 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:14:43.406078 run osmo-hlr_10.42.42.2(pid=23155): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23155)] 20:14:43.454380 run osmo-hlr_10.42.42.2(pid=23155): stdout: | (launched: 2022-12-12_20:14:40.157353) 20:14:43.504897 run osmo-hlr_10.42.42.2(pid=23155): stderr: | 20221212201440337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201440338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201440338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201440338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201440338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201440338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201440350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201440361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201440361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201440361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:43.555836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23148): Terminating (SIGTERM) 20:14:43.596344 run iperf3-srv_10.42.42.10(pid=23149): Terminating (SIGTERM) 20:14:43.636896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23150): Terminating (SIGTERM) 20:14:43.678007 run iperf3-srv_10.42.42.10(pid=23151): Terminating (SIGTERM) 20:14:43.718519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23154): Terminating (SIGTERM) 20:14:43.759271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23157): Terminating (SIGTERM) 20:14:43.799691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23160): Terminating (SIGTERM) 20:14:43.840410 --- ParallelTerminationStrategy: PID 23148 died... 20:14:43.860083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23148): Terminated: ok {rc=0} 20:14:43.905459 --- ParallelTerminationStrategy: PID 23149 died... 20:14:43.924348 run iperf3-srv_10.42.42.10(pid=23149): Terminated {rc=256} 20:14:43.969211 --- ParallelTerminationStrategy: PID 23150 died... 20:14:43.988085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23150): Terminated: ok {rc=0} 20:14:44.033272 --- ParallelTerminationStrategy: PID 23151 died... 20:14:44.052276 run iperf3-srv_10.42.42.10(pid=23151): Terminated {rc=256} 20:14:44.096878 --- ParallelTerminationStrategy: PID 23154 died... 20:14:44.116073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23154): Terminated: ok {rc=0} 20:14:44.160759 --- ParallelTerminationStrategy: PID 23157 died... 20:14:44.179819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23157): Terminated: ok {rc=0} 20:14:44.224358 --- ParallelTerminationStrategy: PID 23160 died... 20:14:44.243368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23160): Terminated: ok {rc=0} 20:14:44.328113 bus /gobi_0: Setting Powered False 20:14:45.426382 bus /gobi_0: Setting Powered False 20:14:46.555173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:14:47.724534 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:47.737144 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:14:47.802685 tst iperf3.py: using LAC 31235 20:14:47.930739 tst iperf3.py: using RAC 125 20:14:48.059279 tst iperf3.py: using CellId 31235 20:14:48.189743 tst iperf3.py: using BVCI 31236 20:14:48.309089 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.320763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.332271 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.344143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.355864 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.367497 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.379344 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.390897 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:48.402880 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:14:48.519888 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:14:48.728087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:49.038499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23162): Launched 20:14:49.310823 run iperf3-srv_10.42.42.10(pid=23163): Launched 20:14:49.428340 tst iperf3.py:8: start network... 20:14:49.634174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:50.112371 run create_hlr_db(pid=23164): Launched 20:14:50.240075 bus /gobi_6: Setting Powered False 20:14:51.302625 run create_hlr_db(pid=23164): Terminated: ok {rc=0} 20:14:51.732709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23166): Launched 20:14:52.044023 run osmo-hlr_10.42.42.2(pid=23167): Launched 20:14:52.163046 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:52.700598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23169): Launched 20:14:53.013254 run osmo-stp_10.42.42.5(pid=23170): Launched 20:14:53.132735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:53.664819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23172): Launched 20:14:53.783070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:54.045123 run patchelf(pid=23173): Launched 20:14:54.218616 run osmo-stp_10.42.42.5(pid=23170): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23170)] 20:14:54.349341 run osmo-stp_10.42.42.5(pid=23170): stdout: | (launched: 2022-12-12_20:14:52.955188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:54.481806 run osmo-stp_10.42.42.5(pid=23170): stderr: | 20221212201453129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201453130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201453130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201453130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201453131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201453131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201453131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:54.614384 run osmo-stp_10.42.42.5(pid=23170): stdout: | (launched: 2022-12-12_20:14:52.955188) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:54.740787 run osmo-stp_10.42.42.5(pid=23170): stderr: | 20221212201453129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201453130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201453130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201453130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201453131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201453131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201453131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:54.890936 run patchelf(pid=23173): Terminating (SIGINT) 20:14:55.064168 run patchelf(pid=23173): Terminated: ok {rc=0} 20:14:55.189470 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23170): Process ended prematurely: osmo-stp_10.42.42.5(pid=23170) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23170)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 20:14:55.199049 tst iperf3.py:8: Test FAILED (7.5 sec) 20:14:55.226929 run osmo-hlr_10.42.42.2(pid=23167): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23167)] 20:14:55.275503 run osmo-hlr_10.42.42.2(pid=23167): stdout: | (launched: 2022-12-12_20:14:51.985591) 20:14:55.325833 run osmo-hlr_10.42.42.2(pid=23167): stderr: | 20221212201452165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201452165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201452165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201452165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201452165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201452165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201452177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201452186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201452187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201452187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:55.376871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23162): Terminating (SIGTERM) 20:14:55.417396 run iperf3-srv_10.42.42.10(pid=23163): Terminating (SIGTERM) 20:14:55.457715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23166): Terminating (SIGTERM) 20:14:55.498050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23169): Terminating (SIGTERM) 20:14:55.538397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23172): Terminating (SIGTERM) 20:14:55.579069 --- ParallelTerminationStrategy: PID 23162 died... 20:14:55.598769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23162): Terminated: ok {rc=0} 20:14:55.643837 --- ParallelTerminationStrategy: PID 23163 died... 20:14:55.662948 run iperf3-srv_10.42.42.10(pid=23163): Terminated {rc=256} 20:14:55.707789 --- ParallelTerminationStrategy: PID 23166 died... 20:14:55.726899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23166): Terminated: ok {rc=0} 20:14:55.771653 --- ParallelTerminationStrategy: PID 23169 died... 20:14:55.791087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23169): Terminated: ok {rc=0} 20:14:55.835935 --- ParallelTerminationStrategy: PID 23172 died... 20:14:55.855276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23172): Terminated: ok {rc=0} 20:14:55.943282 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:14:57.094224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.106201 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:14:57.167521 tst iperf3m4.py: using LAC 31236 20:14:57.287763 tst iperf3m4.py: using RAC 126 20:14:57.409979 tst iperf3m4.py: using CellId 31236 20:14:57.532282 tst iperf3m4.py: using BVCI 31237 20:14:57.645302 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.656491 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.667444 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.678377 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.689185 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.700120 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.711166 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.721997 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:14:57.733032 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:14:57.856088 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:14:57.978398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:14:58.100497 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:14:58.219973 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:14:58.426752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:58.737472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23174): Launched 20:14:59.010775 run iperf3-srv_10.42.42.10(pid=23175): Launched 20:14:59.129271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:14:59.335436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:59.646596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23176): Launched 20:14:59.919596 run iperf3-srv_10.42.42.10(pid=23177): Launched 20:15:00.036711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:15:00.242407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:15:00.551930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23178): Launched 20:15:00.825249 run iperf3-srv_10.42.42.10(pid=23179): Launched 20:15:00.970833 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:15:01.203320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:15:01.547355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23180): Launched 20:15:01.883149 run iperf3-srv_10.42.42.10(pid=23184): Launched 20:15:02.027901 tst iperf3m4.py:8: start network... 20:15:02.257380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:02.774794 run create_hlr_db(pid=23185): Launched 20:15:02.901508 bus /gobi_6: Setting Powered False 20:15:03.965392 run create_hlr_db(pid=23185): Terminated: ok {rc=0} 20:15:04.408399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23187): Launched 20:15:04.720001 run osmo-hlr_10.42.42.2(pid=23188): Launched 20:15:04.840642 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:05.377236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23190): Launched 20:15:05.686438 run osmo-stp_10.42.42.5(pid=23191): Launched 20:15:05.806571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:15:06.337642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23193): Launched 20:15:06.456184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:15:06.717090 run patchelf(pid=23194): Launched 20:15:06.891398 run osmo-stp_10.42.42.5(pid=23191): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23191)] 20:15:07.021838 run osmo-stp_10.42.42.5(pid=23191): stdout: | (launched: 2022-12-12_20:15:05.628167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:07.154612 run osmo-stp_10.42.42.5(pid=23191): stderr: | 20221212201505800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201505800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201505800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201505801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201505801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201505802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201505802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:07.286753 run osmo-stp_10.42.42.5(pid=23191): stdout: | (launched: 2022-12-12_20:15:05.628167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:07.412422 run osmo-stp_10.42.42.5(pid=23191): stderr: | 20221212201505800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201505800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201505800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201505801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201505801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201505802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201505802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:07.561697 run patchelf(pid=23194): Terminating (SIGINT) 20:15:07.734260 run patchelf(pid=23194): Terminated: ok {rc=0} 20:15:07.858733 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23191): Process ended prematurely: osmo-stp_10.42.42.5(pid=23191) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23191)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:15:07.868231 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:15:07.896254 run osmo-hlr_10.42.42.2(pid=23188): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23188)] 20:15:07.944178 run osmo-hlr_10.42.42.2(pid=23188): stdout: | (launched: 2022-12-12_20:15:04.661890) 20:15:07.994047 run osmo-hlr_10.42.42.2(pid=23188): stderr: | 20221212201504842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201504842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201504842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201504842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201504842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201504842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201504855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201504866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201504866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201504866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:08.044442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23174): Terminating (SIGTERM) 20:15:08.084795 run iperf3-srv_10.42.42.10(pid=23175): Terminating (SIGTERM) 20:15:08.125176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23176): Terminating (SIGTERM) 20:15:08.165737 run iperf3-srv_10.42.42.10(pid=23177): Terminating (SIGTERM) 20:15:08.205688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23178): Terminating (SIGTERM) 20:15:08.245563 run iperf3-srv_10.42.42.10(pid=23179): Terminating (SIGTERM) 20:15:08.285647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23180): Terminating (SIGTERM) 20:15:08.325556 run iperf3-srv_10.42.42.10(pid=23184): Terminating (SIGTERM) 20:15:08.365316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23187): Terminating (SIGTERM) 20:15:08.405515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23190): Terminating (SIGTERM) 20:15:08.445319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23193): Terminating (SIGTERM) 20:15:08.485578 --- ParallelTerminationStrategy: PID 23174 died... 20:15:08.504495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23174): Terminated: ok {rc=0} 20:15:08.549134 --- ParallelTerminationStrategy: PID 23175 died... 20:15:08.568016 run iperf3-srv_10.42.42.10(pid=23175): Terminated {rc=256} 20:15:08.612713 --- ParallelTerminationStrategy: PID 23176 died... 20:15:08.631829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23176): Terminated: ok {rc=0} 20:15:08.676756 --- ParallelTerminationStrategy: PID 23177 died... 20:15:08.695638 run iperf3-srv_10.42.42.10(pid=23177): Terminated {rc=256} 20:15:08.739911 --- ParallelTerminationStrategy: PID 23178 died... 20:15:08.758927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23178): Terminated: ok {rc=0} 20:15:08.803827 --- ParallelTerminationStrategy: PID 23179 died... 20:15:08.822716 run iperf3-srv_10.42.42.10(pid=23179): Terminated {rc=256} 20:15:08.868115 --- ParallelTerminationStrategy: PID 23180 died... 20:15:08.887145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23180): Terminated: ok {rc=0} 20:15:08.931681 --- ParallelTerminationStrategy: PID 23184 died... 20:15:08.950496 run iperf3-srv_10.42.42.10(pid=23184): Terminated {rc=256} 20:15:08.994831 --- ParallelTerminationStrategy: PID 23187 died... 20:15:09.013754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23187): Terminated: ok {rc=0} 20:15:09.057938 --- ParallelTerminationStrategy: PID 23190 died... 20:15:09.076846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23190): Terminated: ok {rc=0} 20:15:09.121182 --- ParallelTerminationStrategy: PID 23193 died... 20:15:09.140160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23193): Terminated: ok {rc=0} 20:15:09.225300 bus /gobi_4: Setting Powered False 20:15:10.321629 bus /gobi_4: Setting Powered False 20:15:11.437943 bus /gobi_1: Setting Powered False 20:15:12.539738 bus /gobi_1: Setting Powered False 20:15:13.657376 bus /gobi_0: Setting Powered False 20:15:14.759384 bus /gobi_0: Setting Powered False 20:15:15.900161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:15:17.034893 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.051863 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:15:17.136329 tst ping.py: using LAC 31237 20:15:17.264126 tst ping.py: using RAC 127 20:15:17.385519 tst ping.py: using CellId 31237 20:15:17.514056 tst ping.py: using BVCI 31238 20:15:17.632259 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.644178 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.655805 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.668348 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.680762 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.693245 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.705800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:17.718164 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:15:17.838871 tst ping.py:19: start network... 20:15:18.041976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:18.511671 run create_hlr_db(pid=23195): Launched 20:15:18.638436 bus /gobi_6: Setting Powered False 20:15:19.699548 run create_hlr_db(pid=23195): Terminated: ok {rc=0} 20:15:20.146844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23197): Launched 20:15:20.477666 run osmo-hlr_10.42.42.2(pid=23198): Launched 20:15:20.602305 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:21.174715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23200): Launched 20:15:21.501408 run osmo-stp_10.42.42.5(pid=23201): Launched 20:15:21.625533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:15:22.187844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23203): Launched 20:15:22.314709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:15:22.590137 run patchelf(pid=23204): Launched 20:15:22.771823 run osmo-stp_10.42.42.5(pid=23201): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23201)] 20:15:22.908638 run osmo-stp_10.42.42.5(pid=23201): stdout: | (launched: 2022-12-12_20:15:21.440600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:23.047658 run osmo-stp_10.42.42.5(pid=23201): stderr: | 20221212201521634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201521634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201521634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201521635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201521635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201521635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201521635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:23.187326 run osmo-stp_10.42.42.5(pid=23201): stdout: | (launched: 2022-12-12_20:15:21.440600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:23.320476 run osmo-stp_10.42.42.5(pid=23201): stderr: | 20221212201521634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201521634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201521634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201521635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201521635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201521635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201521635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:23.478180 run patchelf(pid=23204): Terminating (SIGINT) 20:15:23.658833 run patchelf(pid=23204): Terminated: ok {rc=0} 20:15:23.789239 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23201): Process ended prematurely: osmo-stp_10.42.42.5(pid=23201) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23201)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 20:15:23.799260 tst ping.py:22: Test FAILED (6.8 sec) 20:15:23.828198 run osmo-hlr_10.42.42.2(pid=23198): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23198)] 20:15:23.878915 run osmo-hlr_10.42.42.2(pid=23198): stdout: | (launched: 2022-12-12_20:15:20.416652) 20:15:23.931898 run osmo-hlr_10.42.42.2(pid=23198): stderr: | 20221212201520618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201520618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201520618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201520618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201520618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201520618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201520630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201520638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201520638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201520638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:23.985007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23197): Terminating (SIGTERM) 20:15:24.027191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23200): Terminating (SIGTERM) 20:15:24.069403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23203): Terminating (SIGTERM) 20:15:24.112598 --- ParallelTerminationStrategy: PID 23197 died... 20:15:24.133058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23197): Terminated: ok {rc=0} 20:15:24.180528 --- ParallelTerminationStrategy: PID 23200 died... 20:15:24.200416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23200): Terminated: ok {rc=0} 20:15:24.247873 --- ParallelTerminationStrategy: PID 23203 died... 20:15:24.267681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23203): Terminated: ok {rc=0} 20:15:24.357024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:15:25.446732 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:25.458637 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:15:25.519997 tst ping_idle_ping.py: using LAC 31238 20:15:25.639130 tst ping_idle_ping.py: using RAC 128 20:15:25.759452 tst ping_idle_ping.py: using CellId 31238 20:15:25.880193 tst ping_idle_ping.py: using BVCI 31239 20:15:25.989678 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:26.000835 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:26.011899 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:26.022960 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:26.033850 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:26.044741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:26.055880 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:15:26.066848 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:15:26.186800 tst ping_idle_ping.py:24: start network... 20:15:26.406493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:26.915544 run create_hlr_db(pid=23205): Launched 20:15:27.041814 bus /gobi_6: Setting Powered False 20:15:28.106581 run create_hlr_db(pid=23205): Terminated: ok {rc=0} 20:15:28.544322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Launched 20:15:28.851956 run osmo-hlr_10.42.42.2(pid=23208): Launched 20:15:28.971109 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:29.499307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23212): Launched 20:15:29.806693 run osmo-stp_10.42.42.5(pid=23213): Launched 20:15:29.924413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:15:30.448631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23215): Launched 20:15:30.564402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:15:30.821627 run patchelf(pid=23216): Launched 20:15:31.001903 run osmo-stp_10.42.42.5(pid=23213): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23213)] 20:15:31.132551 run osmo-stp_10.42.42.5(pid=23213): stdout: | (launched: 2022-12-12_20:15:29.749121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:31.265218 run osmo-stp_10.42.42.5(pid=23213): stderr: | 20221212201529921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201529921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201529921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201529922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201529924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201529924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201529924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:31.397534 run osmo-stp_10.42.42.5(pid=23213): stdout: | (launched: 2022-12-12_20:15:29.749121) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:31.523997 run osmo-stp_10.42.42.5(pid=23213): stderr: | 20221212201529921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201529921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201529921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201529922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201529924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201529924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201529924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:31.673923 run patchelf(pid=23216): Terminating (SIGINT) 20:15:31.852372 run patchelf(pid=23216): Terminated: ok {rc=0} 20:15:31.990060 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23213): Process ended prematurely: osmo-stp_10.42.42.5(pid=23213) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23213)] [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:15:32.000835 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:15:32.033803 run osmo-hlr_10.42.42.2(pid=23208): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23208)] 20:15:32.087898 run osmo-hlr_10.42.42.2(pid=23208): stdout: | (launched: 2022-12-12_20:15:28.794847) 20:15:32.145024 run osmo-hlr_10.42.42.2(pid=23208): stderr: | 20221212201528972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201528972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201528973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201528973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201528973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201528973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201528985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201528997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201528998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201528998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:32.200782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Terminating (SIGTERM) 20:15:32.245240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23212): Terminating (SIGTERM) 20:15:32.285759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23215): Terminating (SIGTERM) 20:15:32.326202 --- ParallelTerminationStrategy: PID 23207 died... 20:15:32.345672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23207): Terminated: ok {rc=0} 20:15:32.390137 --- ParallelTerminationStrategy: PID 23212 died... 20:15:32.409201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23212): Terminated: ok {rc=0} 20:15:32.453811 --- ParallelTerminationStrategy: PID 23215 died... 20:15:32.472611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23215): Terminated: ok {rc=0} 20:15:32.557608 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 20:15:33.856857 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:33.865922 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:15:33.891902 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:15:33.927842 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:15:33.982679 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:15:34.006962 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:15:34.042640 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:15:34.606459 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:15:34.611855 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:34.623959 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:15:34.686672 tst switch_tch_pdch.py: using LAC 31239 20:15:34.813642 tst switch_tch_pdch.py: using RAC 129 20:15:34.939323 tst switch_tch_pdch.py: using CellId 31239 20:15:35.065240 tst switch_tch_pdch.py: using BVCI 31240 20:15:35.185781 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:35.198057 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:35.210311 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:35.222675 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:35.235044 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:35.247319 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:35.259854 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:15:35.272212 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:15:35.391031 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:15:35.511237 tst switch_tch_pdch.py:51: start network... 20:15:35.714659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:36.184729 run create_hlr_db(pid=23220): Launched 20:15:36.310835 bus /gobi_6: Setting Powered False 20:15:37.371692 run create_hlr_db(pid=23220): Terminated: ok {rc=0} 20:15:37.797650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Launched 20:15:38.104223 run osmo-hlr_10.42.42.2(pid=23223): Launched 20:15:38.220466 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:38.747413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Launched 20:15:39.052719 run osmo-stp_10.42.42.5(pid=23226): Launched 20:15:39.171071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:15:39.694783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23228): Launched 20:15:39.812060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:15:40.068282 run patchelf(pid=23229): Launched 20:15:40.237531 run osmo-stp_10.42.42.5(pid=23226): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23226)] 20:15:40.365570 run osmo-stp_10.42.42.5(pid=23226): stdout: | (launched: 2022-12-12_20:15:38.995923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:40.495016 run osmo-stp_10.42.42.5(pid=23226): stderr: | 20221212201539170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201539171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201539171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201539171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201539172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201539172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201539172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:40.624433 run osmo-stp_10.42.42.5(pid=23226): stdout: | (launched: 2022-12-12_20:15:38.995923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:40.748019 run osmo-stp_10.42.42.5(pid=23226): stderr: | 20221212201539170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201539171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201539171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201539171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201539172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201539172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201539172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:40.894711 run patchelf(pid=23229): Terminating (SIGINT) 20:15:41.063721 run patchelf(pid=23229): Terminated: ok {rc=0} 20:15:41.185868 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23226): Process ended prematurely: osmo-stp_10.42.42.5(pid=23226) [trial-2381↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23226)] [trial-2381↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:15:41.194810 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:15:41.225994 run osmo-hlr_10.42.42.2(pid=23223): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23223)] 20:15:41.277097 run osmo-hlr_10.42.42.2(pid=23223): stdout: | (launched: 2022-12-12_20:15:38.047004) 20:15:41.330613 run osmo-hlr_10.42.42.2(pid=23223): stderr: | 20221212201538225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201538225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201538225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201538225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201538225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201538225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201538236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201538245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201538246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201538246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:41.384458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Terminating (SIGTERM) 20:15:41.427360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Terminating (SIGTERM) 20:15:41.469756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23228): Terminating (SIGTERM) 20:15:41.512894 --- ParallelTerminationStrategy: PID 23222 died... 20:15:41.533376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Terminated: ok {rc=0} 20:15:41.581308 --- ParallelTerminationStrategy: PID 23225 died... 20:15:41.601294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Terminated: ok {rc=0} 20:15:41.648613 --- ParallelTerminationStrategy: PID 23228 died... 20:15:41.668496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23228): Terminated: ok {rc=0} 20:15:41.758321 bus /gobi_0: Setting Powered False 20:15:42.859285 bus /gobi_0: Setting Powered False 20:15:43.977477 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 sms:nanobts+band-900 --------------------------------------------------------------------- 20:15:45.225346 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:45.230805 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 20:15:45.264503 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 20:15:45.292258 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 20:15:45.352264 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 20:15:45.385775 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 20:15:45.413178 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 20:15:45.971112 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 20:15:45.978474 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:15:45.990143 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 20:15:46.038173 tst mo_mt_sms.py: using LAC 31240 20:15:46.167997 tst mo_mt_sms.py: using RAC 130 20:15:46.298221 tst mo_mt_sms.py: using CellId 31240 20:15:46.428242 tst mo_mt_sms.py: using BVCI 31241 20:15:46.549240 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:15:46.561631 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:15:46.573909 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:15:46.587225 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:15:46.601641 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:15:46.613762 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 20:15:46.738853 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 20:15:46.862885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:47.373351 run create_hlr_db(pid=23233): Launched 20:15:47.498320 bus /gobi_6: Setting Powered False 20:15:48.563721 run create_hlr_db(pid=23233): Terminated: ok {rc=0} 20:15:48.999452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23235): Launched 20:15:49.307042 run osmo-hlr_10.42.42.2(pid=23236): Launched 20:15:49.423108 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:49.964594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23238): Launched 20:15:50.269406 run osmo-stp_10.42.42.5(pid=23239): Launched 20:15:50.386395 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:50.935134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23241): Launched 20:15:51.242264 run osmo-msc_10.42.42.6(pid=23242): Launched 20:15:51.412900 run osmo-stp_10.42.42.5(pid=23239): ERR: Terminated: ERROR {rc=1} [trial-2381↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23239)] 20:15:51.541525 run osmo-stp_10.42.42.5(pid=23239): stdout: | (launched: 2022-12-12_20:15:50.212138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:51.670452 run osmo-stp_10.42.42.5(pid=23239): stderr: | 20221212201550385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201550385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201550385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201550386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201550386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201550386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201550386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:51.796412 run osmo-stp_10.42.42.5(pid=23239): stdout: | (launched: 2022-12-12_20:15:50.212138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:51.917177 run osmo-stp_10.42.42.5(pid=23239): stderr: | 20221212201550385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201550385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201550385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201550386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201550386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201550386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201550386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:52.061662 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23239): Process ended prematurely: osmo-stp_10.42.42.5(pid=23239) [trial-2381↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23239)] [trial-2381↪sms:nanobts+band-900↪mo_mt_sms.py:16] 20:15:52.069987 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 20:15:52.096551 run osmo-hlr_10.42.42.2(pid=23236): ERR: Terminated: ERROR {rc=237} [trial-2381↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23236)] 20:15:52.145202 run osmo-hlr_10.42.42.2(pid=23236): stdout: | (launched: 2022-12-12_20:15:49.249967) 20:15:52.195395 run osmo-hlr_10.42.42.2(pid=23236): stderr: | 20221212201549429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201549429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201549429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201549429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201549429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201549429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201549441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201549450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201549450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201549450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:52.265370 run osmo-msc_10.42.42.6(pid=23242): ERR: Terminated: ERROR {rc=2} [trial-2381↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23242)] 20:15:52.313577 run osmo-msc_10.42.42.6(pid=23242): stdout: | (launched: 2022-12-12_20:15:51.184391) 20:15:52.363383 run osmo-msc_10.42.42.6(pid=23242): stderr: | 20221212201551457 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201551457 DLGLOBAL DEBUG validating counter group 0x7fd69ca07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201551457 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201551457 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201551457 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201551457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201551459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201551459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201551460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201551460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:52.413730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23235): Terminating (SIGTERM) 20:15:52.453939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23238): Terminating (SIGTERM) 20:15:52.494165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23241): Terminating (SIGTERM) 20:15:52.534871 --- ParallelTerminationStrategy: PID 23235 died... 20:15:52.554263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23235): Terminated: ok {rc=0} 20:15:52.598884 --- ParallelTerminationStrategy: PID 23238 died... 20:15:52.617681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23238): Terminated: ok {rc=0} 20:15:52.661966 --- ParallelTerminationStrategy: PID 23241 died... 20:15:52.680666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23241): Terminated: ok {rc=0} 20:15:52.767923 bus /sierra_3: Setting Powered False 20:15:53.869441 bus /sierra_3: Setting Powered False 20:15:54.986582 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 20:15:56.227207 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:56.232592 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 20:15:56.266547 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 20:15:56.273598 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 20:15:56.314385 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 20:15:56.348079 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 20:15:56.355254 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 20:15:56.870572 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 20:15:56.876021 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 20:15:56.887512 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 20:15:56.938676 tst assert_extension.py: using LAC 31241 20:15:57.065987 tst assert_extension.py: using RAC 131 20:15:57.193043 tst assert_extension.py: using CellId 31241 20:15:57.318137 tst assert_extension.py: using BVCI 31242 20:15:57.435805 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 20:15:57.553918 tst assert_extension.py:10: start nitb and bts... 20:15:57.773776 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:15:58.437668 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23247): Launched 20:15:58.764284 run osmo-nitb_10.42.42.2(pid=23248): Launched 20:15:58.945587 run osmo-nitb_10.42.42.2(pid=23248): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23248)] 20:15:59.091338 run osmo-nitb_10.42.42.2(pid=23248): stdout: | (launched: 2022-12-12_20:15:58.703911) 20:15:59.238828 run osmo-nitb_10.42.42.2(pid=23248): stderr: | (launched: 2022-12-12_20:15:58.751900) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:15:59.386121 run osmo-nitb_10.42.42.2(pid=23248): stdout: | (launched: 2022-12-12_20:15:58.703911) 20:15:59.527679 run osmo-nitb_10.42.42.2(pid=23248): stderr: | (launched: 2022-12-12_20:15:58.751900) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23248): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23248) [trial-2381↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23248)] 20:15:59.887966 tst osmo-nitb_10.42.42.2(pid=23248): stdout: | (launched: 2022-12-12_20:15:58.703911) 20:16:00.019409 tst osmo-nitb_10.42.42.2(pid=23248): stderr: | (launched: 2022-12-12_20:15:58.751900) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:16:00.174354 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23248): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23248) [trial-2381↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23248)] [trial-2381↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 20:16:00.183698 tst assert_extension.py:12: Test FAILED (3.3 sec) 20:16:00.190784 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23247): Terminating (SIGTERM) 20:16:00.402923 --- ParallelTerminationStrategy: PID 23247 died... 20:16:00.424912 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23247): Terminated: ok {rc=0} 20:16:00.514838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 ussd:nanobts+band-900 --------------------------------------------------------------------- 20:16:01.711760 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:01.720736 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 20:16:01.762040 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 20:16:01.790334 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 20:16:01.826395 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 20:16:01.861122 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 20:16:01.889221 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 20:16:02.416397 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 20:16:02.421740 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:16:02.432786 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 20:16:02.480880 tst assert_extension.py: using LAC 31242 20:16:02.607197 tst assert_extension.py: using RAC 132 20:16:02.737866 tst assert_extension.py: using CellId 31242 20:16:02.856651 tst assert_extension.py: using BVCI 31243 20:16:02.965547 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:16:02.976423 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:16:02.987242 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:16:02.998314 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:16:03.009208 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:16:03.019913 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 20:16:03.139401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:03.642893 run create_hlr_db(pid=23252): Launched 20:16:03.767336 bus /sierra_2: Setting Powered False 20:16:04.831928 run create_hlr_db(pid=23252): Terminated: ok {rc=0} 20:16:05.267412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23254): Launched 20:16:05.574812 run osmo-hlr_10.42.42.2(pid=23255): Launched 20:16:05.692248 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:06.220368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23257): Launched 20:16:06.525314 run osmo-stp_10.42.42.5(pid=23258): Launched 20:16:06.642377 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:07.188643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23260): Launched 20:16:07.494107 run osmo-msc_10.42.42.6(pid=23261): Launched 20:16:07.665378 run osmo-stp_10.42.42.5(pid=23258): ERR: Terminated: ERROR {rc=1} [trial-2381↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23258)] 20:16:07.793202 run osmo-stp_10.42.42.5(pid=23258): stdout: | (launched: 2022-12-12_20:16:06.468090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:07.920608 run osmo-stp_10.42.42.5(pid=23258): stderr: | 20221212201606641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201606641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201606642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201606642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201606643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201606643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201606643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:08.046184 run osmo-stp_10.42.42.5(pid=23258): stdout: | (launched: 2022-12-12_20:16:06.468090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:08.166377 run osmo-stp_10.42.42.5(pid=23258): stderr: | 20221212201606641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201606641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201606642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201606642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201606643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201606643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201606643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:08.310324 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23258): Process ended prematurely: osmo-stp_10.42.42.5(pid=23258) [trial-2381↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23258)] [trial-2381↪ussd:nanobts+band-900↪assert_extension.py:17] 20:16:08.318680 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:16:08.345075 run osmo-hlr_10.42.42.2(pid=23255): ERR: Terminated: ERROR {rc=237} [trial-2381↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23255)] 20:16:08.393365 run osmo-hlr_10.42.42.2(pid=23255): stdout: | (launched: 2022-12-12_20:16:05.517636) 20:16:08.443261 run osmo-hlr_10.42.42.2(pid=23255): stderr: | 20221212201605697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201605697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201605697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201605697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201605697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201605698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201605710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201605718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201605719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201605719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:08.512884 run osmo-msc_10.42.42.6(pid=23261): ERR: Terminated: ERROR {rc=2} [trial-2381↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23261)] 20:16:08.560843 run osmo-msc_10.42.42.6(pid=23261): stdout: | (launched: 2022-12-12_20:16:07.437111) 20:16:08.610276 run osmo-msc_10.42.42.6(pid=23261): stderr: | 20221212201607710 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201607711 DLGLOBAL DEBUG validating counter group 0x7effc9b6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201607711 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201607711 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201607711 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201607711 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201607713 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201607713 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201607713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201607714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:08.660249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23254): Terminating (SIGTERM) 20:16:08.700064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23257): Terminating (SIGTERM) 20:16:08.739879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23260): Terminating (SIGTERM) 20:16:08.779984 --- ParallelTerminationStrategy: PID 23254 died... 20:16:08.799265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23254): Terminated: ok {rc=0} 20:16:08.843638 --- ParallelTerminationStrategy: PID 23257 died... 20:16:08.862532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23257): Terminated: ok {rc=0} 20:16:08.907067 --- ParallelTerminationStrategy: PID 23260 died... 20:16:08.925796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23260): Terminated: ok {rc=0} 20:16:09.012374 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:16:10.225118 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:10.233059 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:16:10.265319 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:16:10.291936 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:16:10.345772 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:16:10.378159 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:16:10.404477 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:16:10.958136 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:16:11.013227 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:11.025197 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:16:11.094581 tst mo_mt_call.py: using LAC 31243 20:16:11.225359 tst mo_mt_call.py: using RAC 133 20:16:11.358912 tst mo_mt_call.py: using CellId 31243 20:16:11.487001 tst mo_mt_call.py: using BVCI 31244 20:16:11.606883 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:11.618739 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:11.630358 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:11.642529 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:11.654811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:11.666743 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:16:11.788362 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:16:11.907117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:12.387010 run create_hlr_db(pid=23266): Launched 20:16:12.516423 bus /sierra_2: Setting Powered False 20:16:13.577356 run create_hlr_db(pid=23266): Terminated: ok {rc=0} 20:16:14.029224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23268): Launched 20:16:14.361911 run osmo-hlr_10.42.42.2(pid=23269): Launched 20:16:14.490058 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:15.058637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23271): Launched 20:16:15.391446 run osmo-stp_10.42.42.5(pid=23272): Launched 20:16:15.518808 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:16.126655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23274): Launched 20:16:16.489713 run osmo-msc_10.42.42.6(pid=23275): Launched 20:16:16.809938 run osmo-stp_10.42.42.5(pid=23272): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23272)] 20:16:17.089415 run osmo-stp_10.42.42.5(pid=23272): stdout: | (launched: 2022-12-12_20:16:15.330214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:17.293689 run osmo-stp_10.42.42.5(pid=23272): stderr: | 20221212201615525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201615526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201615526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201615526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201615527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201615527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201615527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:17.433596 run osmo-stp_10.42.42.5(pid=23272): stdout: | (launched: 2022-12-12_20:16:15.330214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:17.566244 run osmo-stp_10.42.42.5(pid=23272): stderr: | 20221212201615525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201615526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201615526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201615526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201615527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201615527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201615527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:17.715006 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23272): Process ended prematurely: osmo-stp_10.42.42.5(pid=23272) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23272)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:16:17.723952 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 20:16:17.751930 run osmo-hlr_10.42.42.2(pid=23269): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23269)] 20:16:17.801218 run osmo-hlr_10.42.42.2(pid=23269): stdout: | (launched: 2022-12-12_20:16:14.300063) 20:16:17.851971 run osmo-hlr_10.42.42.2(pid=23269): stderr: | 20221212201614500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201614500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201614500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201614500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201614500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201614500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201614513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201614523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201614524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201614524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:17.922814 run osmo-msc_10.42.42.6(pid=23275): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23275)] 20:16:17.972142 run osmo-msc_10.42.42.6(pid=23275): stdout: | (launched: 2022-12-12_20:16:16.417086) 20:16:18.022987 run osmo-msc_10.42.42.6(pid=23275): stderr: | 20221212201616818 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201616818 DLGLOBAL DEBUG validating counter group 0x7f48fb005c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201616819 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201616819 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201616819 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201616819 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201616828 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201616828 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201616828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201616828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:18.074519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23268): Terminating (SIGTERM) 20:16:18.115158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23271): Terminating (SIGTERM) 20:16:18.155840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23274): Terminating (SIGTERM) 20:16:18.196683 --- ParallelTerminationStrategy: PID 23268 died... 20:16:18.216194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23268): Terminated: ok {rc=0} 20:16:18.261972 --- ParallelTerminationStrategy: PID 23271 died... 20:16:18.280903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23271): Terminated: ok {rc=0} 20:16:18.326476 --- ParallelTerminationStrategy: PID 23274 died... 20:16:18.345554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23274): Terminated: ok {rc=0} 20:16:18.434262 bus /sierra_3: Setting Powered False 20:16:19.535178 bus /sierra_3: Setting Powered False 20:16:20.652562 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:16:21.800518 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:21.812932 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:16:21.887121 tst mo_mt_call_osmux.py: using LAC 31244 20:16:22.008297 tst mo_mt_call_osmux.py: using RAC 134 20:16:22.129398 tst mo_mt_call_osmux.py: using CellId 31244 20:16:22.248515 tst mo_mt_call_osmux.py: using BVCI 31245 20:16:22.359186 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:22.370469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:22.381543 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:22.393019 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:22.404119 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:16:22.415155 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:16:22.535165 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:16:22.655004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:23.133696 run create_hlr_db(pid=23277): Launched 20:16:23.260558 bus /sierra_2: Setting Powered False 20:16:24.322868 run create_hlr_db(pid=23277): Terminated: ok {rc=0} 20:16:24.774937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23279): Launched 20:16:25.107701 run osmo-hlr_10.42.42.2(pid=23280): Launched 20:16:25.236035 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:25.806853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23282): Launched 20:16:26.141355 run osmo-stp_10.42.42.5(pid=23283): Launched 20:16:26.270269 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:26.870581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23285): Launched 20:16:27.204144 run osmo-msc_10.42.42.6(pid=23286): Launched 20:16:27.391600 run osmo-stp_10.42.42.5(pid=23283): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23283)] 20:16:27.532498 run osmo-stp_10.42.42.5(pid=23283): stdout: | (launched: 2022-12-12_20:16:26.079290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:27.673283 run osmo-stp_10.42.42.5(pid=23283): stderr: | 20221212201626273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201626274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201626274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201626274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201626275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201626275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201626275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:27.811741 run osmo-stp_10.42.42.5(pid=23283): stdout: | (launched: 2022-12-12_20:16:26.079290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:27.943486 run osmo-stp_10.42.42.5(pid=23283): stderr: | 20221212201626273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201626274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201626274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201626274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201626275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201626275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201626275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:28.101582 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23283): Process ended prematurely: osmo-stp_10.42.42.5(pid=23283) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23283)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:16:28.111956 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:16:28.141637 run osmo-hlr_10.42.42.2(pid=23280): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23280)] 20:16:28.192940 run osmo-hlr_10.42.42.2(pid=23280): stdout: | (launched: 2022-12-12_20:16:25.045687) 20:16:28.246143 run osmo-hlr_10.42.42.2(pid=23280): stderr: | 20221212201625245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201625245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201625245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201625245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201625245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201625245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201625258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201625267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201625268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201625268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:28.320063 run osmo-msc_10.42.42.6(pid=23286): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23286)] 20:16:28.371200 run osmo-msc_10.42.42.6(pid=23286): stdout: | (launched: 2022-12-12_20:16:27.142384) 20:16:28.424017 run osmo-msc_10.42.42.6(pid=23286): stderr: | 20221212201627465 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201627465 DLGLOBAL DEBUG validating counter group 0x7fd4af5d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201627465 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201627465 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201627466 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201627466 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201627467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201627468 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201627468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201627468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:28.477582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23279): Terminating (SIGTERM) 20:16:28.520725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23282): Terminating (SIGTERM) 20:16:28.563759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23285): Terminating (SIGTERM) 20:16:28.607202 --- ParallelTerminationStrategy: PID 23279 died... 20:16:28.627855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23279): Terminated: ok {rc=0} 20:16:28.676043 --- ParallelTerminationStrategy: PID 23282 died... 20:16:28.696235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23282): Terminated: ok {rc=0} 20:16:28.744741 --- ParallelTerminationStrategy: PID 23285 died... 20:16:28.764904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23285): Terminated: ok {rc=0} 20:16:28.856383 bus /sierra_3: Setting Powered False 20:16:29.955044 bus /sierra_3: Setting Powered False 20:16:31.068893 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:16:32.323098 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:32.330753 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:16:32.362859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:16:32.389406 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:16:32.442546 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:16:32.475246 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:16:32.501927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:16:33.052251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:16:33.101481 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:33.112827 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:16:33.179869 tst mo_mt_call.py: using LAC 31245 20:16:33.301897 tst mo_mt_call.py: using RAC 135 20:16:33.424154 tst mo_mt_call.py: using CellId 31245 20:16:33.544758 tst mo_mt_call.py: using BVCI 31246 20:16:33.656905 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:33.668660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:33.679746 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:33.690854 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:33.701985 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:33.713038 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:16:33.832282 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:16:33.954332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:34.467062 run create_hlr_db(pid=23291): Launched 20:16:34.596189 bus /sierra_2: Setting Powered False 20:16:35.661310 run create_hlr_db(pid=23291): Terminated: ok {rc=0} 20:16:36.103793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23293): Launched 20:16:36.416359 run osmo-hlr_10.42.42.2(pid=23294): Launched 20:16:36.536750 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:37.070269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23296): Launched 20:16:37.381510 run osmo-stp_10.42.42.5(pid=23297): Launched 20:16:37.502034 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:38.063062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23299): Launched 20:16:38.375555 run osmo-msc_10.42.42.6(pid=23300): Launched 20:16:38.550372 run osmo-stp_10.42.42.5(pid=23297): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23297)] 20:16:38.681312 run osmo-stp_10.42.42.5(pid=23297): stdout: | (launched: 2022-12-12_20:16:37.323112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:38.811356 run osmo-stp_10.42.42.5(pid=23297): stderr: | 20221212201637497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201637497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201637497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201637497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201637498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201637498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201637498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:38.939564 run osmo-stp_10.42.42.5(pid=23297): stdout: | (launched: 2022-12-12_20:16:37.323112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:39.062049 run osmo-stp_10.42.42.5(pid=23297): stderr: | 20221212201637497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201637497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201637497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201637497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201637498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201637498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201637498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:39.208786 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23297): Process ended prematurely: osmo-stp_10.42.42.5(pid=23297) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23297)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:16:39.217878 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:16:39.245131 run osmo-hlr_10.42.42.2(pid=23294): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23294)] 20:16:39.293587 run osmo-hlr_10.42.42.2(pid=23294): stdout: | (launched: 2022-12-12_20:16:36.358533) 20:16:39.343498 run osmo-hlr_10.42.42.2(pid=23294): stderr: | 20221212201636536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201636536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201636536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201636536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201636536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201636536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201636548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201636556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201636556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201636557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:39.413548 run osmo-msc_10.42.42.6(pid=23300): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23300)] 20:16:39.461803 run osmo-msc_10.42.42.6(pid=23300): stdout: | (launched: 2022-12-12_20:16:38.316839) 20:16:39.511802 run osmo-msc_10.42.42.6(pid=23300): stderr: | 20221212201638590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201638590 DLGLOBAL DEBUG validating counter group 0x7f2ca031fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201638590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201638590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201638590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201638590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201638592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201638592 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201638592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201638593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:39.562288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23293): Terminating (SIGTERM) 20:16:39.603211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23296): Terminating (SIGTERM) 20:16:39.643490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23299): Terminating (SIGTERM) 20:16:39.684531 --- ParallelTerminationStrategy: PID 23293 died... 20:16:39.703967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23293): Terminated: ok {rc=0} 20:16:39.748864 --- ParallelTerminationStrategy: PID 23296 died... 20:16:39.767899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23296): Terminated: ok {rc=0} 20:16:39.812438 --- ParallelTerminationStrategy: PID 23299 died... 20:16:39.831959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23299): Terminated: ok {rc=0} 20:16:39.916712 bus /sierra_3: Setting Powered False 20:16:41.016455 bus /sierra_3: Setting Powered False 20:16:42.138671 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:16:43.286444 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:43.298369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:16:43.365560 tst mo_mt_call_osmux.py: using LAC 31246 20:16:43.496941 tst mo_mt_call_osmux.py: using RAC 136 20:16:43.626325 tst mo_mt_call_osmux.py: using CellId 31246 20:16:43.757403 tst mo_mt_call_osmux.py: using BVCI 31247 20:16:43.879006 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:43.890998 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:43.902915 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:43.914985 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:43.927034 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:43.939112 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:16:44.059258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:16:44.177559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:44.659354 run create_hlr_db(pid=23302): Launched 20:16:44.788742 bus /sierra_2: Setting Powered False 20:16:45.872683 run create_hlr_db(pid=23302): Terminated: ok {rc=0} 20:16:46.344175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23304): Launched 20:16:46.696820 run osmo-hlr_10.42.42.2(pid=23305): Launched 20:16:46.896132 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:47.687576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23307): Launched 20:16:48.019594 run osmo-stp_10.42.42.5(pid=23308): Launched 20:16:48.147706 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:48.746540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23310): Launched 20:16:49.080521 run osmo-msc_10.42.42.6(pid=23311): Launched 20:16:49.268152 run osmo-stp_10.42.42.5(pid=23308): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23308)] 20:16:49.408658 run osmo-stp_10.42.42.5(pid=23308): stdout: | (launched: 2022-12-12_20:16:47.958063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:49.549152 run osmo-stp_10.42.42.5(pid=23308): stderr: | 20221212201648152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201648153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201648153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201648153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201648156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201648156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201648156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:49.687583 run osmo-stp_10.42.42.5(pid=23308): stdout: | (launched: 2022-12-12_20:16:47.958063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:49.819430 run osmo-stp_10.42.42.5(pid=23308): stderr: | 20221212201648152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201648153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201648153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201648153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201648156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201648156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201648156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:49.977165 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23308): Process ended prematurely: osmo-stp_10.42.42.5(pid=23308) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23308)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:16:49.987233 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:16:50.016501 run osmo-hlr_10.42.42.2(pid=23305): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23305)] 20:16:50.067799 run osmo-hlr_10.42.42.2(pid=23305): stdout: | (launched: 2022-12-12_20:16:46.627295) 20:16:50.121585 run osmo-hlr_10.42.42.2(pid=23305): stderr: | 20221212201647006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201647006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201647006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201647006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201647006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201647009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201647028 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201647049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201647050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201647052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:50.195538 run osmo-msc_10.42.42.6(pid=23311): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23311)] 20:16:50.246781 run osmo-msc_10.42.42.6(pid=23311): stdout: | (launched: 2022-12-12_20:16:49.019010) 20:16:50.300166 run osmo-msc_10.42.42.6(pid=23311): stderr: | 20221212201649342 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201649343 DLGLOBAL DEBUG validating counter group 0x7f9a11c58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201649343 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201649343 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201649343 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201649343 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201649345 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201649345 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201649346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201649346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:50.353807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23304): Terminating (SIGTERM) 20:16:50.396854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23307): Terminating (SIGTERM) 20:16:50.439938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23310): Terminating (SIGTERM) 20:16:50.483415 --- ParallelTerminationStrategy: PID 23304 died... 20:16:50.504026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23304): Terminated: ok {rc=0} 20:16:50.552212 --- ParallelTerminationStrategy: PID 23307 died... 20:16:50.572464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23307): Terminated: ok {rc=0} 20:16:50.620481 --- ParallelTerminationStrategy: PID 23310 died... 20:16:50.640609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23310): Terminated: ok {rc=0} 20:16:50.730247 bus /sierra_3: Setting Powered False 20:16:51.831156 bus /sierra_3: Setting Powered False 20:16:52.948044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:16:54.206121 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:54.213916 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:16:54.245962 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:16:54.272504 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:16:54.323863 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:16:54.356018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:16:54.382712 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:16:54.935431 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:16:54.984902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:54.996221 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:16:55.061322 tst mo_mt_call.py: using LAC 31247 20:16:55.185322 tst mo_mt_call.py: using RAC 137 20:16:55.305749 tst mo_mt_call.py: using CellId 31247 20:16:55.434742 tst mo_mt_call.py: using BVCI 31248 20:16:55.554558 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:55.566621 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:55.578679 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:55.591044 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:55.603693 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:55.616090 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:55.734290 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:55.851732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:56.329715 run create_hlr_db(pid=23316): Launched 20:16:56.458179 bus /sierra_2: Setting Powered False 20:16:57.519703 run create_hlr_db(pid=23316): Terminated: ok {rc=0} 20:16:57.952667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23318): Launched 20:16:58.264068 run osmo-hlr_10.42.42.2(pid=23319): Launched 20:16:58.382721 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:58.927863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23321): Launched 20:16:59.239844 run osmo-stp_10.42.42.5(pid=23322): Launched 20:16:59.358941 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:59.915931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23324): Launched 20:17:00.225554 run osmo-msc_10.42.42.6(pid=23325): Launched 20:17:00.398961 run osmo-stp_10.42.42.5(pid=23322): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23322)] 20:17:00.528740 run osmo-stp_10.42.42.5(pid=23322): stdout: | (launched: 2022-12-12_20:16:59.181820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:00.658119 run osmo-stp_10.42.42.5(pid=23322): stderr: | 20221212201659354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201659354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201659354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201659355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201659357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201659357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201659357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:00.786377 run osmo-stp_10.42.42.5(pid=23322): stdout: | (launched: 2022-12-12_20:16:59.181820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:00.941906 run osmo-stp_10.42.42.5(pid=23322): stderr: | 20221212201659354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201659354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201659354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201659355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201659357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201659357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201659357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:01.101990 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23322): Process ended prematurely: osmo-stp_10.42.42.5(pid=23322) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23322)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:17:01.112722 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:17:01.140497 run osmo-hlr_10.42.42.2(pid=23319): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23319)] 20:17:01.189698 run osmo-hlr_10.42.42.2(pid=23319): stdout: | (launched: 2022-12-12_20:16:58.206150) 20:17:01.240831 run osmo-hlr_10.42.42.2(pid=23319): stderr: | 20221212201658386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201658387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201658387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201658387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201658387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201658387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201658399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201658408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201658408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201658408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:01.314369 run osmo-msc_10.42.42.6(pid=23325): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23325)] 20:17:01.373362 run osmo-msc_10.42.42.6(pid=23325): stdout: | (launched: 2022-12-12_20:17:00.167487) 20:17:01.425351 run osmo-msc_10.42.42.6(pid=23325): stderr: | 20221212201700441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201700441 DLGLOBAL DEBUG validating counter group 0x7fce30ba3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201700441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201700441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201700441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201700442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201700443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201700444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201700444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201700444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:01.477490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23318): Terminating (SIGTERM) 20:17:01.519257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23321): Terminating (SIGTERM) 20:17:01.560077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23324): Terminating (SIGTERM) 20:17:01.601439 --- ParallelTerminationStrategy: PID 23318 died... 20:17:01.620878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23318): Terminated: ok {rc=0} 20:17:01.666878 --- ParallelTerminationStrategy: PID 23321 died... 20:17:01.686820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23321): Terminated: ok {rc=0} 20:17:01.749240 --- ParallelTerminationStrategy: PID 23324 died... 20:17:01.776922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23324): Terminated: ok {rc=0} 20:17:01.897975 bus /sierra_3: Setting Powered False 20:17:03.012574 bus /sierra_3: Setting Powered False 20:17:04.154936 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:17:05.307812 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:17:05.320456 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:17:05.390945 tst mo_mt_call_osmux.py: using LAC 31248 20:17:05.519968 tst mo_mt_call_osmux.py: using RAC 138 20:17:05.650280 tst mo_mt_call_osmux.py: using CellId 31248 20:17:05.780046 tst mo_mt_call_osmux.py: using BVCI 31249 20:17:05.901856 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:17:05.913834 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:17:05.925528 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:17:05.937402 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:17:05.949361 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:17:05.961353 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:17:06.081218 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:17:06.202242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:06.684934 run create_hlr_db(pid=23344): Launched 20:17:06.813244 bus /sierra_2: Setting Powered False 20:17:07.875629 run create_hlr_db(pid=23344): Terminated: ok {rc=0} 20:17:08.329211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23346): Launched 20:17:08.662892 run osmo-hlr_10.42.42.2(pid=23347): Launched 20:17:08.791257 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:09.364863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23349): Launched 20:17:09.698456 run osmo-stp_10.42.42.5(pid=23350): Launched 20:17:09.826647 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:10.426456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23352): Launched 20:17:10.759702 run osmo-msc_10.42.42.6(pid=23353): Launched 20:17:10.945837 run osmo-stp_10.42.42.5(pid=23350): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23350)] 20:17:11.085440 run osmo-stp_10.42.42.5(pid=23350): stdout: | (launched: 2022-12-12_20:17:09.636527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:11.225979 run osmo-stp_10.42.42.5(pid=23350): stderr: | 20221212201709830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201709830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201709831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201709831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201709831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201709832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201709832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:11.364269 run osmo-stp_10.42.42.5(pid=23350): stdout: | (launched: 2022-12-12_20:17:09.636527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:11.495856 run osmo-stp_10.42.42.5(pid=23350): stderr: | 20221212201709830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201709830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201709831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201709831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201709831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201709832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201709832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:11.653686 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23350): Process ended prematurely: osmo-stp_10.42.42.5(pid=23350) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23350)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:17:11.663761 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:17:11.692685 run osmo-hlr_10.42.42.2(pid=23347): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23347)] 20:17:11.743682 run osmo-hlr_10.42.42.2(pid=23347): stdout: | (launched: 2022-12-12_20:17:08.601003) 20:17:11.796401 run osmo-hlr_10.42.42.2(pid=23347): stderr: | 20221212201708802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201708802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201708802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201708802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201708802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201708802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201708813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201708823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201708823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201708823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:11.870209 run osmo-msc_10.42.42.6(pid=23353): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23353)] 20:17:11.921513 run osmo-msc_10.42.42.6(pid=23353): stdout: | (launched: 2022-12-12_20:17:10.697838) 20:17:11.974217 run osmo-msc_10.42.42.6(pid=23353): stderr: | 20221212201711022 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201711022 DLGLOBAL DEBUG validating counter group 0x7f640c367c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201711022 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201711022 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201711022 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201711022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201711024 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201711024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201711025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201711025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:12.027099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23346): Terminating (SIGTERM) 20:17:12.069687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23349): Terminating (SIGTERM) 20:17:12.112229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23352): Terminating (SIGTERM) 20:17:12.155479 --- ParallelTerminationStrategy: PID 23346 died... 20:17:12.176089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23346): Terminated: ok {rc=0} 20:17:12.223514 --- ParallelTerminationStrategy: PID 23349 died... 20:17:12.243358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23349): Terminated: ok {rc=0} 20:17:12.290528 --- ParallelTerminationStrategy: PID 23352 died... 20:17:12.310404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23352): Terminated: ok {rc=0} 20:17:12.399735 bus /sierra_3: Setting Powered False 20:17:13.501209 bus /sierra_3: Setting Powered False 20:17:14.620649 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:17:15.894351 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:15.902729 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:17:15.941404 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:17:15.971983 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:17:16.030720 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:17:16.065443 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:17:16.093397 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:17:16.678020 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:17:16.749314 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:16.765733 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:17:16.852942 tst mo_mt_call.py: using LAC 31249 20:17:16.986999 tst mo_mt_call.py: using RAC 139 20:17:17.109716 tst mo_mt_call.py: using CellId 31249 20:17:17.231183 tst mo_mt_call.py: using BVCI 31250 20:17:17.350244 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:17.361846 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:17.373267 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:17.384747 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:17.396351 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:17.407916 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:17:17.530235 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:17:17.649905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:18.163037 run create_hlr_db(pid=23359): Launched 20:17:18.290223 bus /sierra_2: Setting Powered False 20:17:19.355954 run create_hlr_db(pid=23359): Terminated: ok {rc=0} 20:17:19.797147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23361): Launched 20:17:20.110571 run osmo-hlr_10.42.42.2(pid=23362): Launched 20:17:20.230788 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:20.763709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23364): Launched 20:17:21.073638 run osmo-stp_10.42.42.5(pid=23366): Launched 20:17:21.192807 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:21.750888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23368): Launched 20:17:22.062804 run osmo-msc_10.42.42.6(pid=23369): Launched 20:17:22.237360 run osmo-stp_10.42.42.5(pid=23366): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23366)] 20:17:22.367620 run osmo-stp_10.42.42.5(pid=23366): stdout: | (launched: 2022-12-12_20:17:21.015625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:22.497906 run osmo-stp_10.42.42.5(pid=23366): stderr: | 20221212201721187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201721187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201721188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201721188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201721190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201721190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201721190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:22.625690 run osmo-stp_10.42.42.5(pid=23366): stdout: | (launched: 2022-12-12_20:17:21.015625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:22.747848 run osmo-stp_10.42.42.5(pid=23366): stderr: | 20221212201721187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201721187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201721188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201721188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201721190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201721190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201721190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:22.893944 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23366): Process ended prematurely: osmo-stp_10.42.42.5(pid=23366) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23366)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:17:22.902757 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:17:22.929494 run osmo-hlr_10.42.42.2(pid=23362): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23362)] 20:17:22.977473 run osmo-hlr_10.42.42.2(pid=23362): stdout: | (launched: 2022-12-12_20:17:20.052246) 20:17:23.027403 run osmo-hlr_10.42.42.2(pid=23362): stderr: | 20221212201720231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201720232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201720232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201720232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201720232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201720232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201720249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201720259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201720259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201720259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:23.097249 run osmo-msc_10.42.42.6(pid=23369): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23369)] 20:17:23.145346 run osmo-msc_10.42.42.6(pid=23369): stdout: | (launched: 2022-12-12_20:17:22.004793) 20:17:23.195314 run osmo-msc_10.42.42.6(pid=23369): stderr: | 20221212201722281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201722282 DLGLOBAL DEBUG validating counter group 0x7f103ca98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201722282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201722282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201722282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201722282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201722284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201722284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201722284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201722284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:23.245860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23361): Terminating (SIGTERM) 20:17:23.285857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23364): Terminating (SIGTERM) 20:17:23.325883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23368): Terminating (SIGTERM) 20:17:23.366241 --- ParallelTerminationStrategy: PID 23361 died... 20:17:23.385627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23361): Terminated: ok {rc=0} 20:17:23.430223 --- ParallelTerminationStrategy: PID 23364 died... 20:17:23.449107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23364): Terminated: ok {rc=0} 20:17:23.493463 --- ParallelTerminationStrategy: PID 23368 died... 20:17:23.512302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23368): Terminated: ok {rc=0} 20:17:23.599708 bus /sierra_3: Setting Powered False 20:17:24.701229 bus /sierra_3: Setting Powered False 20:17:25.817988 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:17:26.967584 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:26.979806 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:17:27.047748 tst mo_mt_call_osmux.py: using LAC 31250 20:17:27.169701 tst mo_mt_call_osmux.py: using RAC 140 20:17:27.290951 tst mo_mt_call_osmux.py: using CellId 31250 20:17:27.414639 tst mo_mt_call_osmux.py: using BVCI 31251 20:17:27.528687 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:27.540096 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:27.551417 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:27.563124 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:27.574924 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:27.586712 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:17:27.707995 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:17:27.827326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:28.309444 run create_hlr_db(pid=23371): Launched 20:17:28.437442 bus /sierra_2: Setting Powered False 20:17:29.499387 run create_hlr_db(pid=23371): Terminated: ok {rc=0} 20:17:29.952157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23373): Launched 20:17:30.286268 run osmo-hlr_10.42.42.2(pid=23374): Launched 20:17:30.414938 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:31.024469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23376): Launched 20:17:31.366851 run osmo-stp_10.42.42.5(pid=23377): Launched 20:17:31.651843 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:32.337278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23379): Launched 20:17:32.670628 run osmo-msc_10.42.42.6(pid=23380): Launched 20:17:32.855856 run osmo-stp_10.42.42.5(pid=23377): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23377)] 20:17:32.995100 run osmo-stp_10.42.42.5(pid=23377): stdout: | (launched: 2022-12-12_20:17:31.305254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:33.135937 run osmo-stp_10.42.42.5(pid=23377): stderr: | 20221212201731561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201731561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201731561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201731562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201731562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201731562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201731562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:33.274768 run osmo-stp_10.42.42.5(pid=23377): stdout: | (launched: 2022-12-12_20:17:31.305254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:33.406698 run osmo-stp_10.42.42.5(pid=23377): stderr: | 20221212201731561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201731561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201731561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201731562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201731562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201731562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201731562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:33.564526 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23377): Process ended prematurely: osmo-stp_10.42.42.5(pid=23377) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23377)] [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:17:33.574523 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:17:33.603722 run osmo-hlr_10.42.42.2(pid=23374): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23374)] 20:17:33.654823 run osmo-hlr_10.42.42.2(pid=23374): stdout: | (launched: 2022-12-12_20:17:30.224658) 20:17:33.707862 run osmo-hlr_10.42.42.2(pid=23374): stderr: | 20221212201730428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201730428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201730428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201730428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201730428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201730428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201730444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201730454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201730454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201730454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:33.781582 run osmo-msc_10.42.42.6(pid=23380): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23380)] 20:17:33.832448 run osmo-msc_10.42.42.6(pid=23380): stdout: | (launched: 2022-12-12_20:17:32.608450) 20:17:33.885192 run osmo-msc_10.42.42.6(pid=23380): stderr: | 20221212201732933 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201732933 DLGLOBAL DEBUG validating counter group 0x7f6ea652ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201732933 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201732933 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201732934 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201732934 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201732935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201732936 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201732936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201732936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:33.938490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23373): Terminating (SIGTERM) 20:17:33.981343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23376): Terminating (SIGTERM) 20:17:34.024227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23379): Terminating (SIGTERM) 20:17:34.067304 --- ParallelTerminationStrategy: PID 23373 died... 20:17:34.087749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23373): Terminated: ok {rc=0} 20:17:34.136057 --- ParallelTerminationStrategy: PID 23376 died... 20:17:34.156024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23376): Terminated: ok {rc=0} 20:17:34.203965 --- ParallelTerminationStrategy: PID 23379 died... 20:17:34.223983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23379): Terminated: ok {rc=0} 20:17:34.313802 bus /sierra_3: Setting Powered False 20:17:35.415110 bus /sierra_3: Setting Powered False 20:17:36.531962 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:17:37.785669 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:37.794774 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:17:37.827035 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:17:37.853834 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:17:37.907165 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:17:37.939430 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:17:37.966357 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:17:38.517979 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:17:38.567409 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:38.578810 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:17:38.646132 tst mo_mt_call.py: using LAC 31251 20:17:38.768294 tst mo_mt_call.py: using RAC 141 20:17:38.889806 tst mo_mt_call.py: using CellId 31251 20:17:39.009817 tst mo_mt_call.py: using BVCI 31252 20:17:39.123074 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:39.134542 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:39.145812 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:39.157111 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:39.168459 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:39.179733 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:39.299014 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:39.419805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:39.899677 run create_hlr_db(pid=23385): Launched 20:17:40.025321 bus /sierra_2: Setting Powered False 20:17:41.086814 run create_hlr_db(pid=23385): Terminated: ok {rc=0} 20:17:41.539695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23387): Launched 20:17:41.872214 run osmo-hlr_10.42.42.2(pid=23388): Launched 20:17:41.999399 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:42.576119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23390): Launched 20:17:42.909257 run osmo-stp_10.42.42.5(pid=23391): Launched 20:17:43.037116 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:43.636718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23393): Launched 20:17:43.968923 run osmo-msc_10.42.42.6(pid=23394): Launched 20:17:44.155563 run osmo-stp_10.42.42.5(pid=23391): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23391)] 20:17:44.295026 run osmo-stp_10.42.42.5(pid=23391): stdout: | (launched: 2022-12-12_20:17:42.847591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:44.435388 run osmo-stp_10.42.42.5(pid=23391): stderr: | 20221212201743042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201743042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201743042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201743043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201743043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201743043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201743043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:44.573807 run osmo-stp_10.42.42.5(pid=23391): stdout: | (launched: 2022-12-12_20:17:42.847591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:44.705270 run osmo-stp_10.42.42.5(pid=23391): stderr: | 20221212201743042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201743042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201743042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201743043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201743043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201743043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201743043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:44.862421 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23391): Process ended prematurely: osmo-stp_10.42.42.5(pid=23391) [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23391)] [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:17:44.872250 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:17:44.901582 run osmo-hlr_10.42.42.2(pid=23388): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23388)] 20:17:44.952522 run osmo-hlr_10.42.42.2(pid=23388): stdout: | (launched: 2022-12-12_20:17:41.810883) 20:17:45.005400 run osmo-hlr_10.42.42.2(pid=23388): stderr: | 20221212201742013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201742013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201742013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201742013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201742013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201742014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201742026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201742035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201742035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201742035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:45.078929 run osmo-msc_10.42.42.6(pid=23394): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23394)] 20:17:45.129944 run osmo-msc_10.42.42.6(pid=23394): stdout: | (launched: 2022-12-12_20:17:43.907464) 20:17:45.182854 run osmo-msc_10.42.42.6(pid=23394): stderr: | 20221212201744231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201744231 DLGLOBAL DEBUG validating counter group 0x7fca92ff0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201744231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201744231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201744232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201744232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201744233 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201744234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201744234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201744234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:45.236122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23387): Terminating (SIGTERM) 20:17:45.279041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23390): Terminating (SIGTERM) 20:17:45.321861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23393): Terminating (SIGTERM) 20:17:45.364780 --- ParallelTerminationStrategy: PID 23387 died... 20:17:45.385245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23387): Terminated: ok {rc=0} 20:17:45.433283 --- ParallelTerminationStrategy: PID 23390 died... 20:17:45.453290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23390): Terminated: ok {rc=0} 20:17:45.500918 --- ParallelTerminationStrategy: PID 23393 died... 20:17:45.520941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23393): Terminated: ok {rc=0} 20:17:45.611466 bus /sierra_3: Setting Powered False 20:17:46.710587 bus /sierra_3: Setting Powered False 20:17:47.830578 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:17:48.983012 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:48.995794 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:17:49.069575 tst mo_mt_call_osmux.py: using LAC 31252 20:17:49.190441 tst mo_mt_call_osmux.py: using RAC 142 20:17:49.309688 tst mo_mt_call_osmux.py: using CellId 31252 20:17:49.428841 tst mo_mt_call_osmux.py: using BVCI 31253 20:17:49.540466 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:49.551817 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:49.563100 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:49.574344 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:49.585899 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:49.597046 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:49.718193 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:49.836871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:50.319536 run create_hlr_db(pid=23396): Launched 20:17:50.446604 bus /sierra_2: Setting Powered False 20:17:51.508701 run create_hlr_db(pid=23396): Terminated: ok {rc=0} 20:17:51.962824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23398): Launched 20:17:52.297105 run osmo-hlr_10.42.42.2(pid=23399): Launched 20:17:52.425799 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:52.996079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23401): Launched 20:17:53.331274 run osmo-stp_10.42.42.5(pid=23402): Launched 20:17:53.460930 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:54.072940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23404): Launched 20:17:54.400910 run osmo-msc_10.42.42.6(pid=23405): Launched 20:17:54.583020 run osmo-stp_10.42.42.5(pid=23402): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23402)] 20:17:54.719574 run osmo-stp_10.42.42.5(pid=23402): stdout: | (launched: 2022-12-12_20:17:53.269623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:54.856818 run osmo-stp_10.42.42.5(pid=23402): stderr: | 20221212201753464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201753464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201753464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201753464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201753465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201753465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201753465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:54.992696 run osmo-stp_10.42.42.5(pid=23402): stdout: | (launched: 2022-12-12_20:17:53.269623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:55.122035 run osmo-stp_10.42.42.5(pid=23402): stderr: | 20221212201753464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201753464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201753464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201753464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201753465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201753465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201753465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:55.277147 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23402): Process ended prematurely: osmo-stp_10.42.42.5(pid=23402) [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23402)] [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:17:55.286665 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:17:55.315386 run osmo-hlr_10.42.42.2(pid=23399): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23399)] 20:17:55.366012 run osmo-hlr_10.42.42.2(pid=23399): stdout: | (launched: 2022-12-12_20:17:52.235554) 20:17:55.418292 run osmo-hlr_10.42.42.2(pid=23399): stderr: | 20221212201752438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201752438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201752438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201752438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201752438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201752438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201752448 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201752457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201752457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201752457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:55.491299 run osmo-msc_10.42.42.6(pid=23405): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23405)] 20:17:55.541966 run osmo-msc_10.42.42.6(pid=23405): stdout: | (launched: 2022-12-12_20:17:54.340368) 20:17:55.594419 run osmo-msc_10.42.42.6(pid=23405): stderr: | 20221212201754660 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201754660 DLGLOBAL DEBUG validating counter group 0x7f17abac5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201754660 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201754660 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201754660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201754660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201754662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201754663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201754663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201754663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:55.647225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23398): Terminating (SIGTERM) 20:17:55.689207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23401): Terminating (SIGTERM) 20:17:55.731460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23404): Terminating (SIGTERM) 20:17:55.774106 --- ParallelTerminationStrategy: PID 23398 died... 20:17:55.794285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23398): Terminated: ok {rc=0} 20:17:55.841416 --- ParallelTerminationStrategy: PID 23401 died... 20:17:55.861165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23401): Terminated: ok {rc=0} 20:17:55.908165 --- ParallelTerminationStrategy: PID 23404 died... 20:17:55.928042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23404): Terminated: ok {rc=0} 20:17:56.017318 bus /sierra_3: Setting Powered False 20:17:57.116913 bus /sierra_3: Setting Powered False 20:17:58.234527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:17:59.487218 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:59.495122 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:17:59.529374 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 20:17:59.556783 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 20:17:59.611899 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:17:59.645248 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 20:17:59.672351 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 20:18:00.224390 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 20:18:00.276659 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:00.288533 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:18:00.339267 tst mo_mt_call.py: using LAC 31253 20:18:00.467140 tst mo_mt_call.py: using RAC 143 20:18:00.594546 tst mo_mt_call.py: using CellId 31253 20:18:00.721921 tst mo_mt_call.py: using BVCI 31254 20:18:00.850886 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:00.864069 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:00.876180 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:00.894007 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:00.912441 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:00.925960 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:18:01.047634 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:18:01.198196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:01.741726 run create_hlr_db(pid=23412): Launched 20:18:01.900595 bus /sierra_2: Setting Powered False 20:18:02.965884 run create_hlr_db(pid=23412): Terminated: ok {rc=0} 20:18:03.419605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23414): Launched 20:18:03.745667 run osmo-hlr_10.42.42.2(pid=23415): Launched 20:18:03.870461 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:04.431992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23417): Launched 20:18:04.756856 run osmo-stp_10.42.42.5(pid=23418): Launched 20:18:04.880845 run osmo-msc_10.42.42.6: Starting osmo-msc 20:18:05.465165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23420): Launched 20:18:05.789165 run osmo-msc_10.42.42.6(pid=23421): Launched 20:18:05.969713 run osmo-stp_10.42.42.5(pid=23418): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23418)] 20:18:06.105906 run osmo-stp_10.42.42.5(pid=23418): stdout: | (launched: 2022-12-12_20:18:04.697101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:06.243350 run osmo-stp_10.42.42.5(pid=23418): stderr: | 20221212201804884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201804884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201804885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201804885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201804886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201804886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201804886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:06.378500 run osmo-stp_10.42.42.5(pid=23418): stdout: | (launched: 2022-12-12_20:18:04.697101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:06.507077 run osmo-stp_10.42.42.5(pid=23418): stderr: | 20221212201804884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201804884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201804885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201804885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201804886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201804886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201804886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:06.661115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23418): Process ended prematurely: osmo-stp_10.42.42.5(pid=23418) [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23418)] [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 20:18:06.670525 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:18:06.698887 run osmo-hlr_10.42.42.2(pid=23415): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23415)] 20:18:06.749273 run osmo-hlr_10.42.42.2(pid=23415): stdout: | (launched: 2022-12-12_20:18:03.684777) 20:18:06.801692 run osmo-hlr_10.42.42.2(pid=23415): stderr: | 20221212201803880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201803880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201803880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201803880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201803880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201803880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201803892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201803900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201803900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201803900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:06.874560 run osmo-msc_10.42.42.6(pid=23421): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23421)] 20:18:06.924792 run osmo-msc_10.42.42.6(pid=23421): stdout: | (launched: 2022-12-12_20:18:05.728864) 20:18:06.976753 run osmo-msc_10.42.42.6(pid=23421): stderr: | 20221212201806046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201806047 DLGLOBAL DEBUG validating counter group 0x7f49594bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201806047 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201806047 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201806047 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201806047 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201806049 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201806049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201806049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201806049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:18:07.029487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23414): Terminating (SIGTERM) 20:18:07.071400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23417): Terminating (SIGTERM) 20:18:07.113449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23420): Terminating (SIGTERM) 20:18:07.156042 --- ParallelTerminationStrategy: PID 23414 died... 20:18:07.176163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23414): Terminated: ok {rc=0} 20:18:07.222977 --- ParallelTerminationStrategy: PID 23417 died... 20:18:07.242599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23417): Terminated: ok {rc=0} 20:18:07.289356 --- ParallelTerminationStrategy: PID 23420 died... 20:18:07.308864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23420): Terminated: ok {rc=0} 20:18:07.396547 bus /sierra_3: Setting Powered False 20:18:08.495565 bus /sierra_3: Setting Powered False 20:18:09.613117 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 20:18:10.762454 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:10.774940 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:18:10.826552 tst mo_mt_call_osmux.py: using LAC 31254 20:18:10.953190 tst mo_mt_call_osmux.py: using RAC 144 20:18:11.072342 tst mo_mt_call_osmux.py: using CellId 31254 20:18:11.193345 tst mo_mt_call_osmux.py: using BVCI 31255 20:18:11.303568 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:11.315138 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:11.326373 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:11.337653 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:11.349014 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:18:11.360234 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:18:11.478737 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:18:11.602391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:12.104760 run create_hlr_db(pid=23423): Launched 20:18:12.229085 bus /sierra_2: Setting Powered False 20:18:13.292204 run create_hlr_db(pid=23423): Terminated: ok {rc=0} 20:18:13.744399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23425): Launched 20:18:14.070753 run osmo-hlr_10.42.42.2(pid=23426): Launched 20:18:14.195330 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:14.752247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23428): Launched 20:18:15.073266 run osmo-stp_10.42.42.5(pid=23429): Launched 20:18:15.196934 run osmo-msc_10.42.42.6: Starting osmo-msc 20:18:15.775279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23431): Launched 20:18:16.117179 run osmo-msc_10.42.42.6(pid=23432): Launched 20:18:16.490540 run osmo-stp_10.42.42.5(pid=23429): ERR: Terminated: ERROR {rc=1} [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23429)] 20:18:16.825567 run osmo-stp_10.42.42.5(pid=23429): stdout: | (launched: 2022-12-12_20:18:15.014000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:17.117390 run osmo-stp_10.42.42.5(pid=23429): stderr: | 20221212201815201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201815201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201815202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201815202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201815202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201815202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201815203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:17.258943 run osmo-stp_10.42.42.5(pid=23429): stdout: | (launched: 2022-12-12_20:18:15.014000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:17.391492 run osmo-stp_10.42.42.5(pid=23429): stderr: | 20221212201815201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201815201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201815202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201815202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201815202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201815202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201815203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:17.548718 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23429): Process ended prematurely: osmo-stp_10.42.42.5(pid=23429) [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23429)] [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 20:18:17.558351 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 20:18:17.586923 run osmo-hlr_10.42.42.2(pid=23426): ERR: Terminated: ERROR {rc=237} [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23426)] 20:18:17.637415 run osmo-hlr_10.42.42.2(pid=23426): stdout: | (launched: 2022-12-12_20:18:14.010974) 20:18:17.689918 run osmo-hlr_10.42.42.2(pid=23426): stderr: | 20221212201814207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201814207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201814207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201814207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201814207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201814207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201814220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201814229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201814229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201814229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:17.763034 run osmo-msc_10.42.42.6(pid=23432): ERR: Terminated: ERROR {rc=2} [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23432)] 20:18:17.813459 run osmo-msc_10.42.42.6(pid=23432): stdout: | (launched: 2022-12-12_20:18:16.047392) 20:18:17.865710 run osmo-msc_10.42.42.6(pid=23432): stderr: | 20221212201816776 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201816777 DLGLOBAL DEBUG validating counter group 0x7f6d5f26cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201816777 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201816778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201816778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201816779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201816782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201816783 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201816783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201816783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:18:17.918469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23425): Terminating (SIGTERM) 20:18:17.960808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23428): Terminating (SIGTERM) 20:18:18.003227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23431): Terminating (SIGTERM) 20:18:18.045709 --- ParallelTerminationStrategy: PID 23425 died... 20:18:18.065521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23425): Terminated: ok {rc=0} 20:18:18.113132 --- ParallelTerminationStrategy: PID 23428 died... 20:18:18.133050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23428): Terminated: ok {rc=0} 20:18:18.180808 --- ParallelTerminationStrategy: PID 23431 died... 20:18:18.200664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23431): Terminated: ok {rc=0} 20:18:18.290564 bus /sierra_3: Setting Powered False 20:18:19.390802 bus /sierra_3: Setting Powered False 20:18:20.510346 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 emergency:nanobts+band-900 --------------------------------------------------------------------- 20:18:21.764690 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:18:21.770021 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 20:18:21.801585 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 20:18:21.827914 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 20:18:21.913860 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 20:18:21.945853 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 20:18:21.971842 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 20:18:22.553463 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2381 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 20:18:22.558493 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:22.569379 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 20:18:22.616596 tst emergency_mo_mt_call.py: using LAC 31255 20:18:22.732175 tst emergency_mo_mt_call.py: using RAC 145 20:18:22.847298 tst emergency_mo_mt_call.py: using CellId 31255 20:18:22.964596 tst emergency_mo_mt_call.py: using BVCI 31256 20:18:23.070224 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:23.081013 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:23.091551 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:23.102131 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:23.112566 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:23.123086 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:23.236594 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:23.349939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:23.807673 run create_hlr_db(pid=23437): Launched 20:18:23.928909 bus /sierra_2: Setting Powered False 20:18:24.987839 run create_hlr_db(pid=23437): Terminated: ok {rc=0} 20:18:25.402857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23439): Launched 20:18:25.699313 run osmo-hlr_10.42.42.2(pid=23440): Launched 20:18:25.810908 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:26.331068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23442): Launched 20:18:26.627615 run osmo-stp_10.42.42.5(pid=23443): Launched 20:18:26.749656 tst emergency_mo_mt_call.py: using MSISDN 7946 20:18:26.898001 run osmo-msc_10.42.42.6: Starting osmo-msc 20:18:27.429791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23445): Launched 20:18:27.726392 run osmo-msc_10.42.42.6(pid=23446): Launched 20:18:27.892399 run osmo-stp_10.42.42.5(pid=23443): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23443)] 20:18:28.017245 run osmo-stp_10.42.42.5(pid=23443): stdout: | (launched: 2022-12-12_20:18:26.572023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:28.141743 run osmo-stp_10.42.42.5(pid=23443): stderr: | 20221212201826741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201826742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201826742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201826743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201826743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201826743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201826743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:28.264801 run osmo-stp_10.42.42.5(pid=23443): stdout: | (launched: 2022-12-12_20:18:26.572023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:28.383985 run osmo-stp_10.42.42.5(pid=23443): stderr: | 20221212201826741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201826742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201826742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201826743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201826743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201826743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201826743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:28.525462 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23443): Process ended prematurely: osmo-stp_10.42.42.5(pid=23443) [trial-2381↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23443)] [trial-2381↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 20:18:28.533882 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 20:18:28.560166 run osmo-hlr_10.42.42.2(pid=23440): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23440)] 20:18:28.607844 run osmo-hlr_10.42.42.2(pid=23440): stdout: | (launched: 2022-12-12_20:18:25.643881) 20:18:28.657532 run osmo-hlr_10.42.42.2(pid=23440): stderr: | 20221212201825818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201825818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201825818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201825818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201825818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201825818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201825830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201825840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201825840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201825840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:28.726585 run osmo-msc_10.42.42.6(pid=23446): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23446)] 20:18:28.774055 run osmo-msc_10.42.42.6(pid=23446): stdout: | (launched: 2022-12-12_20:18:27.670560) 20:18:28.823256 run osmo-msc_10.42.42.6(pid=23446): stderr: | 20221212201827939 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201827939 DLGLOBAL DEBUG validating counter group 0x7f361ce99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201827939 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201827939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201827939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201827939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201827941 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201827943 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201827943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201827943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:18:28.872524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23439): Terminating (SIGTERM) 20:18:28.911742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23442): Terminating (SIGTERM) 20:18:28.950893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23445): Terminating (SIGTERM) 20:18:28.990522 --- ParallelTerminationStrategy: PID 23439 died... 20:18:29.009696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23439): Terminated: ok {rc=0} 20:18:29.053964 --- ParallelTerminationStrategy: PID 23442 died... 20:18:29.072419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23442): Terminated: ok {rc=0} 20:18:29.116109 --- ParallelTerminationStrategy: PID 23445 died... 20:18:29.134748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23445): Terminated: ok {rc=0} 20:18:29.220677 bus /sierra_3: Setting Powered False 20:18:30.320848 bus /sierra_3: Setting Powered False 20:18:31.434671 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 20:18:32.520096 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:32.531651 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 20:18:32.585431 tst emergency_preemptive_call.py: using LAC 31256 20:18:32.700562 tst emergency_preemptive_call.py: using RAC 146 20:18:32.817638 tst emergency_preemptive_call.py: using CellId 31256 20:18:32.933991 tst emergency_preemptive_call.py: using BVCI 31257 20:18:33.041627 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:33.052420 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:33.062947 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:33.073422 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:33.083810 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 20:18:33.094250 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:33.213839 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:33.329322 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:33.446896 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:33.561283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:34.059240 run create_hlr_db(pid=23448): Launched 20:18:34.182117 bus /sierra_2: Setting Powered False 20:18:35.246150 run create_hlr_db(pid=23448): Terminated: ok {rc=0} 20:18:35.670383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23450): Launched 20:18:35.969204 run osmo-hlr_10.42.42.2(pid=23451): Launched 20:18:36.081989 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:36.608931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23453): Launched 20:18:36.908141 run osmo-stp_10.42.42.5(pid=23454): Launched 20:18:37.032039 tst emergency_preemptive_call.py: using MSISDN 7947 20:18:37.184123 run osmo-msc_10.42.42.6: Starting osmo-msc 20:18:37.717334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23456): Launched 20:18:38.014842 run osmo-msc_10.42.42.6(pid=23457): Launched 20:18:38.180069 run osmo-stp_10.42.42.5(pid=23454): ERR: Terminated: ERROR {rc=1} [trial-2381↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23454)] 20:18:38.305958 run osmo-stp_10.42.42.5(pid=23454): stdout: | (launched: 2022-12-12_20:18:36.852576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:38.431494 run osmo-stp_10.42.42.5(pid=23454): stderr: | 20221212201837019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201837019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201837019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201837020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201837020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201837020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201837020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:38.556625 run osmo-stp_10.42.42.5(pid=23454): stdout: | (launched: 2022-12-12_20:18:36.852576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:38.674794 run osmo-stp_10.42.42.5(pid=23454): stderr: | 20221212201837019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201837019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201837019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201837020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201837020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201837020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201837020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:38.816113 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23454): Process ended prematurely: osmo-stp_10.42.42.5(pid=23454) [trial-2381↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23454)] [trial-2381↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 20:18:38.824628 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 20:18:38.850990 run osmo-hlr_10.42.42.2(pid=23451): ERR: Terminated: ERROR {rc=237} [trial-2381↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23451)] 20:18:38.898578 run osmo-hlr_10.42.42.2(pid=23451): stdout: | (launched: 2022-12-12_20:18:35.914050) 20:18:38.947881 run osmo-hlr_10.42.42.2(pid=23451): stderr: | 20221212201836086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201836086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201836087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201836087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201836087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201836087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201836099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201836108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201836108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201836108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:39.017587 run osmo-msc_10.42.42.6(pid=23457): ERR: Terminated: ERROR {rc=2} [trial-2381↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23457)] 20:18:39.065362 run osmo-msc_10.42.42.6(pid=23457): stdout: | (launched: 2022-12-12_20:18:37.959803) 20:18:39.114605 run osmo-msc_10.42.42.6(pid=23457): stderr: | 20221212201838231 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212201838231 DLGLOBAL DEBUG validating counter group 0x7f5d24d48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212201838231 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212201838231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212201838232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212201838232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212201838234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212201838234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212201838234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212201838234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:18:39.164096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23450): Terminating (SIGTERM) 20:18:39.203603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23453): Terminating (SIGTERM) 20:18:39.243644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23456): Terminating (SIGTERM) 20:18:39.283457 --- ParallelTerminationStrategy: PID 23450 died... 20:18:39.302625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23450): Terminated: ok {rc=0} 20:18:39.346722 --- ParallelTerminationStrategy: PID 23453 died... 20:18:39.365625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23453): Terminated: ok {rc=0} 20:18:39.409790 --- ParallelTerminationStrategy: PID 23456 died... 20:18:39.428413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23456): Terminated: ok {rc=0} 20:18:39.515067 bus /sierra_9: Setting Powered False 20:18:40.615604 bus /sierra_9: Setting Powered False 20:18:41.731625 bus /sierra_8: Setting Powered False 20:18:42.831963 bus /sierra_8: Setting Powered False 20:18:43.947657 bus /sierra_3: Setting Powered False 20:18:45.046007 bus /sierra_3: Setting Powered False 20:18:46.176921 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900 --------------------------------------------------------------------- 20:18:47.456769 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:18:47.462491 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 20:18:47.496180 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 20:18:47.535767 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 20:18:47.626426 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 20:18:47.660319 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 20:18:47.700047 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 20:18:48.286073 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 20:18:48.336217 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.347239 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 20:18:48.395397 tst cs_paging_gprs_active.py: using LAC 31257 20:18:48.516540 tst cs_paging_gprs_active.py: using RAC 147 20:18:48.636253 tst cs_paging_gprs_active.py: using CellId 31257 20:18:48.756123 tst cs_paging_gprs_active.py: using BVCI 31258 20:18:48.866385 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.877174 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.887607 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.898384 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.908911 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.919580 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.930508 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.941079 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:18:48.951738 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:49.065070 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:18:49.187435 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:18:49.408767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:49.737382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23462): Launched 20:18:50.022170 run iperf3-srv_10.42.42.10(pid=23463): Launched 20:18:50.144419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:18:50.364651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:50.691408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23464): Launched 20:18:50.975934 run iperf3-srv_10.42.42.10(pid=23465): Launched 20:18:51.098314 tst cs_paging_gprs_active.py:38: start network... 20:18:51.318468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:51.822061 run create_hlr_db(pid=23466): Launched 20:18:51.947318 bus /sierra_2: Setting Powered False 20:18:53.011468 run create_hlr_db(pid=23466): Terminated: ok {rc=0} 20:18:53.446678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23468): Launched 20:18:53.750994 run osmo-hlr_10.42.42.2(pid=23469): Launched 20:18:53.866747 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:54.403254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23471): Launched 20:18:54.709232 run osmo-stp_10.42.42.5(pid=23472): Launched 20:18:54.824649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:18:55.347007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23474): Launched 20:18:55.463790 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:18:55.721746 run patchelf(pid=23475): Launched 20:18:55.891199 run osmo-stp_10.42.42.5(pid=23472): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23472)] 20:18:56.019962 run osmo-stp_10.42.42.5(pid=23472): stdout: | (launched: 2022-12-12_20:18:54.652898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:56.150427 run osmo-stp_10.42.42.5(pid=23472): stderr: | 20221212201854821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201854821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201854822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201854822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201854823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201854823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201854823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:56.281076 run osmo-stp_10.42.42.5(pid=23472): stdout: | (launched: 2022-12-12_20:18:54.652898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:56.405365 run osmo-stp_10.42.42.5(pid=23472): stderr: | 20221212201854821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201854821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201854822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201854822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201854823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201854823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201854823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:56.552143 run patchelf(pid=23475): Terminating (SIGINT) 20:18:56.723461 run patchelf(pid=23475): Terminated: ok {rc=0} 20:18:56.845995 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23472): Process ended prematurely: osmo-stp_10.42.42.5(pid=23472) [trial-2381↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23472)] [trial-2381↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 20:18:56.855365 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:18:56.882801 run osmo-hlr_10.42.42.2(pid=23469): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23469)] 20:18:56.930711 run osmo-hlr_10.42.42.2(pid=23469): stdout: | (launched: 2022-12-12_20:18:53.695197) 20:18:56.980271 run osmo-hlr_10.42.42.2(pid=23469): stderr: | 20221212201853869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201853869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201853869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201853869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201853869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201853869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201853880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201853889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201853889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201853889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:57.030546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23462): Terminating (SIGTERM) 20:18:57.070413 run iperf3-srv_10.42.42.10(pid=23463): Terminating (SIGTERM) 20:18:57.110137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23464): Terminating (SIGTERM) 20:18:57.150309 run iperf3-srv_10.42.42.10(pid=23465): Terminating (SIGTERM) 20:18:57.190191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23468): Terminating (SIGTERM) 20:18:57.230199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23471): Terminating (SIGTERM) 20:18:57.270072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23474): Terminating (SIGTERM) 20:18:57.310505 --- ParallelTerminationStrategy: PID 23462 died... 20:18:57.329797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23462): Terminated: ok {rc=0} 20:18:57.374184 --- ParallelTerminationStrategy: PID 23463 died... 20:18:57.392716 run iperf3-srv_10.42.42.10(pid=23463): Terminated {rc=256} 20:18:57.437103 --- ParallelTerminationStrategy: PID 23464 died... 20:18:57.455836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23464): Terminated: ok {rc=0} 20:18:57.500436 --- ParallelTerminationStrategy: PID 23465 died... 20:18:57.519148 run iperf3-srv_10.42.42.10(pid=23465): Terminated {rc=256} 20:18:57.562881 --- ParallelTerminationStrategy: PID 23468 died... 20:18:57.581648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23468): Terminated: ok {rc=0} 20:18:57.625544 --- ParallelTerminationStrategy: PID 23471 died... 20:18:57.644324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23471): Terminated: ok {rc=0} 20:18:57.688198 --- ParallelTerminationStrategy: PID 23474 died... 20:18:57.706966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23474): Terminated: ok {rc=0} 20:18:57.792275 bus /gobi_0: Setting Powered False 20:18:58.892637 bus /gobi_0: Setting Powered False 20:19:00.010312 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 20:19:01.185664 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.202711 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 20:19:01.266313 tst iperf3.py: using LAC 31258 20:19:01.442150 tst iperf3.py: using RAC 148 20:19:01.609050 tst iperf3.py: using CellId 31258 20:19:01.738778 tst iperf3.py: using BVCI 31259 20:19:01.892129 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.904449 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.919096 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.932917 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.947317 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.961908 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.975855 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:01.989597 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:02.004140 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:19:02.146653 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:19:02.392324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:02.721849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23476): Launched 20:19:03.006884 run iperf3-srv_10.42.42.10(pid=23477): Launched 20:19:03.131647 tst iperf3.py:8: start network... 20:19:03.352848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:03.858696 run create_hlr_db(pid=23478): Launched 20:19:03.983877 bus /gobi_6: Setting Powered False 20:19:05.049262 run create_hlr_db(pid=23478): Terminated: ok {rc=0} 20:19:05.485148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23480): Launched 20:19:05.789937 run osmo-hlr_10.42.42.2(pid=23481): Launched 20:19:05.905277 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:06.428552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23483): Launched 20:19:06.732795 run osmo-stp_10.42.42.5(pid=23484): Launched 20:19:06.848558 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:07.371455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23486): Launched 20:19:07.487620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:07.744188 run patchelf(pid=23487): Launched 20:19:07.913744 run osmo-stp_10.42.42.5(pid=23484): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23484)] 20:19:08.042496 run osmo-stp_10.42.42.5(pid=23484): stdout: | (launched: 2022-12-12_20:19:06.676616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:08.172766 run osmo-stp_10.42.42.5(pid=23484): stderr: | 20221212201906845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201906845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201906846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201906846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201906846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201906847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201906847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:08.303118 run osmo-stp_10.42.42.5(pid=23484): stdout: | (launched: 2022-12-12_20:19:06.676616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:08.427349 run osmo-stp_10.42.42.5(pid=23484): stderr: | 20221212201906845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201906845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201906846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201906846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201906846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201906847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201906847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:08.574727 run patchelf(pid=23487): Terminating (SIGINT) 20:19:08.744763 run patchelf(pid=23487): Terminated: ok {rc=0} 20:19:08.868006 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23484): Process ended prematurely: osmo-stp_10.42.42.5(pid=23484) [trial-2381↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23484)] [trial-2381↪gprs:nanobts+band-900↪iperf3.py:8] 20:19:08.877676 tst iperf3.py:8: Test FAILED (7.8 sec) 20:19:08.904771 run osmo-hlr_10.42.42.2(pid=23481): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23481)] 20:19:08.952542 run osmo-hlr_10.42.42.2(pid=23481): stdout: | (launched: 2022-12-12_20:19:05.733698) 20:19:09.002024 run osmo-hlr_10.42.42.2(pid=23481): stderr: | 20221212201905906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201905906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201905906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201905906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201905907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201905907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201905919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201905927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201905927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201905927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:09.051711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23476): Terminating (SIGTERM) 20:19:09.091562 run iperf3-srv_10.42.42.10(pid=23477): Terminating (SIGTERM) 20:19:09.131471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23480): Terminating (SIGTERM) 20:19:09.171356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23483): Terminating (SIGTERM) 20:19:09.211005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23486): Terminating (SIGTERM) 20:19:09.251495 --- ParallelTerminationStrategy: PID 23476 died... 20:19:09.270795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23476): Terminated: ok {rc=0} 20:19:09.314947 --- ParallelTerminationStrategy: PID 23477 died... 20:19:09.333689 run iperf3-srv_10.42.42.10(pid=23477): Terminated {rc=256} 20:19:09.377551 --- ParallelTerminationStrategy: PID 23480 died... 20:19:09.396314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23480): Terminated: ok {rc=0} 20:19:09.440229 --- ParallelTerminationStrategy: PID 23483 died... 20:19:09.459132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23483): Terminated: ok {rc=0} 20:19:09.503166 --- ParallelTerminationStrategy: PID 23486 died... 20:19:09.522029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23486): Terminated: ok {rc=0} 20:19:09.607464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 20:19:10.755815 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:10.767642 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 20:19:10.816177 tst iperf3m4.py: using LAC 31259 20:19:10.936415 tst iperf3m4.py: using RAC 149 20:19:11.054508 tst iperf3m4.py: using CellId 31259 20:19:11.174235 tst iperf3m4.py: using BVCI 31260 20:19:11.285345 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.295919 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.306494 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.316925 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.327333 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.337849 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.348484 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.358869 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:11.369463 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:19:11.487105 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:19:11.608484 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:19:11.726049 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:19:11.845674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:19:12.068813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:12.398100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23488): Launched 20:19:12.683694 run iperf3-srv_10.42.42.10(pid=23489): Launched 20:19:12.806601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:19:13.026578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:13.355392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23490): Launched 20:19:13.640340 run iperf3-srv_10.42.42.10(pid=23491): Launched 20:19:13.764232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:19:13.984135 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:14.313525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23492): Launched 20:19:14.597596 run iperf3-srv_10.42.42.10(pid=23493): Launched 20:19:14.721082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:19:14.940320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:15.268196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23494): Launched 20:19:15.552408 run iperf3-srv_10.42.42.10(pid=23495): Launched 20:19:15.676719 tst iperf3m4.py:8: start network... 20:19:15.903412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:16.396930 run create_hlr_db(pid=23496): Launched 20:19:16.557620 bus /gobi_6: Setting Powered False 20:19:17.618765 run create_hlr_db(pid=23496): Terminated: ok {rc=0} 20:19:18.068699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Launched 20:19:18.397891 run osmo-hlr_10.42.42.2(pid=23499): Launched 20:19:18.523694 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:19.086969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Launched 20:19:19.415792 run osmo-stp_10.42.42.5(pid=23502): Launched 20:19:19.540098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:20.103538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23504): Launched 20:19:20.231008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:20.507912 run patchelf(pid=23505): Launched 20:19:20.691658 run osmo-stp_10.42.42.5(pid=23502): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] 20:19:20.830464 run osmo-stp_10.42.42.5(pid=23502): stdout: | (launched: 2022-12-12_20:19:19.355499) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:20.971878 run osmo-stp_10.42.42.5(pid=23502): stderr: | 20221212201919545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201919545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201919545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201919546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201919546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201919546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201919546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:21.112365 run osmo-stp_10.42.42.5(pid=23502): stdout: | (launched: 2022-12-12_20:19:19.355499) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:21.247322 run osmo-stp_10.42.42.5(pid=23502): stderr: | 20221212201919545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201919545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201919545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201919546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201919546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201919546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201919546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:21.406540 run patchelf(pid=23505): Terminating (SIGINT) 20:19:21.590127 run patchelf(pid=23505): Terminated: ok {rc=0} 20:19:21.722929 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23502): Process ended prematurely: osmo-stp_10.42.42.5(pid=23502) [trial-2381↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] [trial-2381↪gprs:nanobts+band-900↪iperf3m4.py:8] 20:19:21.733239 tst iperf3m4.py:8: Test FAILED (11.0 sec) 20:19:21.763278 run osmo-hlr_10.42.42.2(pid=23499): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23499)] 20:19:21.814295 run osmo-hlr_10.42.42.2(pid=23499): stdout: | (launched: 2022-12-12_20:19:18.337796) 20:19:21.867283 run osmo-hlr_10.42.42.2(pid=23499): stderr: | 20221212201918532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201918532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201918532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201918532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201918532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201918533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201918544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201918553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201918553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201918554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:21.920781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23488): Terminating (SIGTERM) 20:19:21.963285 run iperf3-srv_10.42.42.10(pid=23489): Terminating (SIGTERM) 20:19:22.006090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23490): Terminating (SIGTERM) 20:19:22.048788 run iperf3-srv_10.42.42.10(pid=23491): Terminating (SIGTERM) 20:19:22.091417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23492): Terminating (SIGTERM) 20:19:22.134044 run iperf3-srv_10.42.42.10(pid=23493): Terminating (SIGTERM) 20:19:22.176450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23494): Terminating (SIGTERM) 20:19:22.219394 run iperf3-srv_10.42.42.10(pid=23495): Terminating (SIGTERM) 20:19:22.262113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Terminating (SIGTERM) 20:19:22.304719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Terminating (SIGTERM) 20:19:22.347478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23504): Terminating (SIGTERM) 20:19:22.390440 --- ParallelTerminationStrategy: PID 23488 died... 20:19:22.410868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23488): Terminated: ok {rc=0} 20:19:22.458514 --- ParallelTerminationStrategy: PID 23489 died... 20:19:22.478430 run iperf3-srv_10.42.42.10(pid=23489): Terminated {rc=256} 20:19:22.525699 --- ParallelTerminationStrategy: PID 23490 died... 20:19:22.545592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23490): Terminated: ok {rc=0} 20:19:22.592702 --- ParallelTerminationStrategy: PID 23491 died... 20:19:22.612502 run iperf3-srv_10.42.42.10(pid=23491): Terminated {rc=256} 20:19:22.659747 --- ParallelTerminationStrategy: PID 23492 died... 20:19:22.679689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23492): Terminated: ok {rc=0} 20:19:22.727016 --- ParallelTerminationStrategy: PID 23493 died... 20:19:22.746845 run iperf3-srv_10.42.42.10(pid=23493): Terminated {rc=256} 20:19:22.793907 --- ParallelTerminationStrategy: PID 23494 died... 20:19:22.813802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23494): Terminated: ok {rc=0} 20:19:22.861676 --- ParallelTerminationStrategy: PID 23495 died... 20:19:22.881656 run iperf3-srv_10.42.42.10(pid=23495): Terminated {rc=256} 20:19:22.928765 --- ParallelTerminationStrategy: PID 23498 died... 20:19:22.948624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Terminated: ok {rc=0} 20:19:22.996029 --- ParallelTerminationStrategy: PID 23501 died... 20:19:23.015909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Terminated: ok {rc=0} 20:19:23.063255 --- ParallelTerminationStrategy: PID 23504 died... 20:19:23.083352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23504): Terminated: ok {rc=0} 20:19:23.172503 bus /gobi_4: Setting Powered False 20:19:24.273843 bus /gobi_4: Setting Powered False 20:19:25.391833 bus /gobi_1: Setting Powered False 20:19:26.491558 bus /gobi_1: Setting Powered False 20:19:27.611932 bus /gobi_0: Setting Powered False 20:19:28.711949 bus /gobi_0: Setting Powered False 20:19:29.828111 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900 ping.py ---------------------------------------------- 20:19:30.945164 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:30.957886 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 20:19:31.010450 tst ping.py: using LAC 31260 20:19:31.129444 tst ping.py: using RAC 150 20:19:31.258738 tst ping.py: using CellId 31260 20:19:31.387971 tst ping.py: using BVCI 31261 20:19:31.508075 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:31.521520 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:31.533804 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:31.547170 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:31.560787 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:31.574692 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:31.587259 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:31.600561 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:19:31.723138 tst ping.py:19: start network... 20:19:31.945373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:32.450622 run create_hlr_db(pid=23506): Launched 20:19:32.575628 bus /gobi_6: Setting Powered False 20:19:33.640600 run create_hlr_db(pid=23506): Terminated: ok {rc=0} 20:19:34.069760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23508): Launched 20:19:34.371640 run osmo-hlr_10.42.42.2(pid=23511): Launched 20:19:34.488051 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:35.007232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23513): Launched 20:19:35.306681 run osmo-stp_10.42.42.5(pid=23514): Launched 20:19:35.421215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:35.936347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23516): Launched 20:19:36.050781 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:36.303485 run patchelf(pid=23517): Launched 20:19:36.470491 run osmo-stp_10.42.42.5(pid=23514): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23514)] 20:19:36.596618 run osmo-stp_10.42.42.5(pid=23514): stdout: | (launched: 2022-12-12_20:19:35.250987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:36.724409 run osmo-stp_10.42.42.5(pid=23514): stderr: | 20221212201935418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201935418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201935419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201935419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201935420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201935420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201935420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:36.851987 run osmo-stp_10.42.42.5(pid=23514): stdout: | (launched: 2022-12-12_20:19:35.250987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:36.973980 run osmo-stp_10.42.42.5(pid=23514): stderr: | 20221212201935418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201935418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201935419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201935419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201935420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201935420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201935420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:37.118907 run patchelf(pid=23517): Terminating (SIGINT) 20:19:37.285729 run patchelf(pid=23517): Terminated: ok {rc=0} 20:19:37.405473 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23514): Process ended prematurely: osmo-stp_10.42.42.5(pid=23514) [trial-2381↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23514)] [trial-2381↪gprs:nanobts+band-900↪ping.py:22] 20:19:37.414328 tst ping.py:22: Test FAILED (6.5 sec) 20:19:37.441495 run osmo-hlr_10.42.42.2(pid=23511): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23511)] 20:19:37.489612 run osmo-hlr_10.42.42.2(pid=23511): stdout: | (launched: 2022-12-12_20:19:34.313502) 20:19:37.539431 run osmo-hlr_10.42.42.2(pid=23511): stderr: | 20221212201934489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201934489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201934489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201934489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201934490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201934490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201934501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201934510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201934510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201934510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:37.589727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23508): Terminating (SIGTERM) 20:19:37.629739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23513): Terminating (SIGTERM) 20:19:37.669782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23516): Terminating (SIGTERM) 20:19:37.710306 --- ParallelTerminationStrategy: PID 23508 died... 20:19:37.729700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23508): Terminated: ok {rc=0} 20:19:37.773953 --- ParallelTerminationStrategy: PID 23513 died... 20:19:37.792687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23513): Terminated: ok {rc=0} 20:19:37.837311 --- ParallelTerminationStrategy: PID 23516 died... 20:19:37.856016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23516): Terminated: ok {rc=0} 20:19:37.940308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 20:19:39.023992 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.035445 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 20:19:39.084655 tst ping_idle_ping.py: using LAC 31261 20:19:39.203109 tst ping_idle_ping.py: using RAC 151 20:19:39.321388 tst ping_idle_ping.py: using CellId 31261 20:19:39.438213 tst ping_idle_ping.py: using BVCI 31262 20:19:39.548622 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.559460 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.570190 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.580796 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.591429 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.602017 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.612594 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 20:19:39.623283 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 20:19:39.737448 tst ping_idle_ping.py:24: start network... 20:19:39.937134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:40.405624 run create_hlr_db(pid=23518): Launched 20:19:40.529111 bus /gobi_6: Setting Powered False 20:19:41.589619 run create_hlr_db(pid=23518): Terminated: ok {rc=0} 20:19:42.029871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23520): Launched 20:19:42.354538 run osmo-hlr_10.42.42.2(pid=23521): Launched 20:19:42.479144 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:43.036440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23523): Launched 20:19:43.362051 run osmo-stp_10.42.42.5(pid=23524): Launched 20:19:43.487060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:44.043708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23526): Launched 20:19:44.168908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:44.442922 run patchelf(pid=23527): Launched 20:19:44.623907 run osmo-stp_10.42.42.5(pid=23524): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23524)] 20:19:44.760009 run osmo-stp_10.42.42.5(pid=23524): stdout: | (launched: 2022-12-12_20:19:43.302322) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:44.898099 run osmo-stp_10.42.42.5(pid=23524): stderr: | 20221212201943490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201943491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201943491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201943491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201943492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201943492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201943492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:45.035922 run osmo-stp_10.42.42.5(pid=23524): stdout: | (launched: 2022-12-12_20:19:43.302322) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:45.168063 run osmo-stp_10.42.42.5(pid=23524): stderr: | 20221212201943490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201943491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201943491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201943491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201943492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201943492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201943492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:45.325681 run patchelf(pid=23527): Terminating (SIGINT) 20:19:45.506187 run patchelf(pid=23527): Terminated: ok {rc=0} 20:19:45.635932 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23524): Process ended prematurely: osmo-stp_10.42.42.5(pid=23524) [trial-2381↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23524)] [trial-2381↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 20:19:45.645578 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:19:45.674828 run osmo-hlr_10.42.42.2(pid=23521): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23521)] 20:19:45.726019 run osmo-hlr_10.42.42.2(pid=23521): stdout: | (launched: 2022-12-12_20:19:42.295218) 20:19:45.778917 run osmo-hlr_10.42.42.2(pid=23521): stderr: | 20221212201942487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201942487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201942487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201942487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201942487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201942487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201942502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201942511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201942512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201942512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:45.832371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23520): Terminating (SIGTERM) 20:19:45.888041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23523): Terminating (SIGTERM) 20:19:45.941899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23526): Terminating (SIGTERM) 20:19:45.985751 --- ParallelTerminationStrategy: PID 23520 died... 20:19:46.006165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23520): Terminated: ok {rc=0} 20:19:46.056812 --- ParallelTerminationStrategy: PID 23523 died... 20:19:46.077372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23523): Terminated: ok {rc=0} 20:19:46.125736 --- ParallelTerminationStrategy: PID 23526 died... 20:19:46.146136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23526): Terminated: ok {rc=0} 20:19:46.237441 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 20:19:47.543036 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:19:47.549714 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:19:47.583793 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:19:47.623578 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:19:47.711409 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:19:47.744496 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:19:47.784113 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:19:48.387816 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:19:48.441732 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:48.453380 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:19:48.502028 tst cs_paging_gprs_active.py: using LAC 31262 20:19:48.622034 tst cs_paging_gprs_active.py: using RAC 152 20:19:48.740333 tst cs_paging_gprs_active.py: using CellId 31262 20:19:48.857171 tst cs_paging_gprs_active.py: using BVCI 31263 20:19:48.967164 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:48.978491 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:48.989440 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:49.000296 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:49.011113 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:49.022062 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:49.033058 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:49.043869 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:49.054754 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:49.175571 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:49.296219 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:19:49.517222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:49.845803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23531): Launched 20:19:50.131028 run iperf3-srv_10.42.42.10(pid=23532): Launched 20:19:50.258191 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:19:50.478633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:50.806859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23533): Launched 20:19:51.095595 run iperf3-srv_10.42.42.10(pid=23534): Launched 20:19:51.219371 tst cs_paging_gprs_active.py:38: start network... 20:19:51.438870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:51.944648 run create_hlr_db(pid=23535): Launched 20:19:52.071555 bus /gobi_6: Setting Powered False 20:19:53.136094 run create_hlr_db(pid=23535): Terminated: ok {rc=0} 20:19:53.573970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23537): Launched 20:19:53.883002 run osmo-hlr_10.42.42.2(pid=23538): Launched 20:19:53.999951 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:54.525161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23540): Launched 20:19:54.830336 run osmo-stp_10.42.42.5(pid=23541): Launched 20:19:54.946435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:55.471734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23543): Launched 20:19:55.589117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:55.847332 run patchelf(pid=23544): Launched 20:19:56.017505 run osmo-stp_10.42.42.5(pid=23541): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23541)] 20:19:56.146569 run osmo-stp_10.42.42.5(pid=23541): stdout: | (launched: 2022-12-12_20:19:54.773897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:56.276907 run osmo-stp_10.42.42.5(pid=23541): stderr: | 20221212201954940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201954940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201954940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201954940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201954941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201954941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201954941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:56.407549 run osmo-stp_10.42.42.5(pid=23541): stdout: | (launched: 2022-12-12_20:19:54.773897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:56.532156 run osmo-stp_10.42.42.5(pid=23541): stderr: | 20221212201954940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212201954940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212201954940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212201954940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212201954941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212201954941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212201954941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:56.679884 run patchelf(pid=23544): Terminating (SIGINT) 20:19:56.851199 run patchelf(pid=23544): Terminated: ok {rc=0} 20:19:56.974287 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23541): Process ended prematurely: osmo-stp_10.42.42.5(pid=23541) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23541)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:19:56.983663 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:19:57.011155 run osmo-hlr_10.42.42.2(pid=23538): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23538)] 20:19:57.059083 run osmo-hlr_10.42.42.2(pid=23538): stdout: | (launched: 2022-12-12_20:19:53.826617) 20:19:57.108526 run osmo-hlr_10.42.42.2(pid=23538): stderr: | 20221212201953999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212201953999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212201953999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212201953999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212201953999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212201953999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212201954014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212201954024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212201954024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212201954024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:57.158813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23531): Terminating (SIGTERM) 20:19:57.198639 run iperf3-srv_10.42.42.10(pid=23532): Terminating (SIGTERM) 20:19:57.238783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23533): Terminating (SIGTERM) 20:19:57.278900 run iperf3-srv_10.42.42.10(pid=23534): Terminating (SIGTERM) 20:19:57.319027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23537): Terminating (SIGTERM) 20:19:57.359078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23540): Terminating (SIGTERM) 20:19:57.399085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23543): Terminating (SIGTERM) 20:19:57.439469 --- ParallelTerminationStrategy: PID 23531 died... 20:19:57.458842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23531): Terminated: ok {rc=0} 20:19:57.503395 --- ParallelTerminationStrategy: PID 23532 died... 20:19:57.522253 run iperf3-srv_10.42.42.10(pid=23532): Terminated {rc=256} 20:19:57.566357 --- ParallelTerminationStrategy: PID 23533 died... 20:19:57.585445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23533): Terminated: ok {rc=0} 20:19:57.629893 --- ParallelTerminationStrategy: PID 23534 died... 20:19:57.648763 run iperf3-srv_10.42.42.10(pid=23534): Terminated {rc=256} 20:19:57.693095 --- ParallelTerminationStrategy: PID 23537 died... 20:19:57.711944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23537): Terminated: ok {rc=0} 20:19:57.756223 --- ParallelTerminationStrategy: PID 23540 died... 20:19:57.775124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23540): Terminated: ok {rc=0} 20:19:57.819406 --- ParallelTerminationStrategy: PID 23543 died... 20:19:57.838343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23543): Terminated: ok {rc=0} 20:19:57.922929 bus /gobi_0: Setting Powered False 20:19:59.020820 bus /gobi_0: Setting Powered False 20:20:00.137283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:20:01.305202 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.320628 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:01.382394 tst iperf3.py: using LAC 31263 20:20:01.517903 tst iperf3.py: using RAC 153 20:20:01.640231 tst iperf3.py: using CellId 31263 20:20:01.808688 tst iperf3.py: using BVCI 31264 20:20:01.939260 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.952121 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.966096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.979145 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.992371 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:02.006933 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:02.019466 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:02.032888 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:02.047291 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:02.191430 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:20:02.397799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:02.703581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23548): Launched 20:20:02.969390 run iperf3-srv_10.42.42.10(pid=23549): Launched 20:20:03.083392 tst iperf3.py:8: start network... 20:20:03.286766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:03.756515 run create_hlr_db(pid=23550): Launched 20:20:03.880827 bus /gobi_6: Setting Powered False 20:20:04.941969 run create_hlr_db(pid=23550): Terminated: ok {rc=0} 20:20:05.373529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23552): Launched 20:20:05.677930 run osmo-hlr_10.42.42.2(pid=23553): Launched 20:20:05.793071 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:06.315613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23555): Launched 20:20:06.649846 run osmo-stp_10.42.42.5(pid=23556): Launched 20:20:06.776814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:07.340698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23558): Launched 20:20:07.467346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:07.743841 run patchelf(pid=23559): Launched 20:20:07.927059 run osmo-stp_10.42.42.5(pid=23556): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23556)] 20:20:08.065066 run osmo-stp_10.42.42.5(pid=23556): stdout: | (launched: 2022-12-12_20:20:06.589674) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:08.205074 run osmo-stp_10.42.42.5(pid=23556): stderr: | 20221212202006779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202006779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202006779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202006779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202006780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202006780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202006780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:08.345495 run osmo-stp_10.42.42.5(pid=23556): stdout: | (launched: 2022-12-12_20:20:06.589674) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:08.479260 run osmo-stp_10.42.42.5(pid=23556): stderr: | 20221212202006779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202006779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202006779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202006779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202006780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202006780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202006780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:08.637703 run patchelf(pid=23559): Terminating (SIGINT) 20:20:08.820277 run patchelf(pid=23559): Terminated: ok {rc=0} 20:20:08.952049 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23556): Process ended prematurely: osmo-stp_10.42.42.5(pid=23556) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23556)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 20:20:08.962296 tst iperf3.py:8: Test FAILED (7.7 sec) 20:20:08.991808 run osmo-hlr_10.42.42.2(pid=23553): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23553)] 20:20:09.042981 run osmo-hlr_10.42.42.2(pid=23553): stdout: | (launched: 2022-12-12_20:20:05.621613) 20:20:09.095782 run osmo-hlr_10.42.42.2(pid=23553): stderr: | 20221212202005796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202005796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202005796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202005796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202005796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202005796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202005809 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202005818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202005818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202005818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:09.148905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23548): Terminating (SIGTERM) 20:20:09.191168 run iperf3-srv_10.42.42.10(pid=23549): Terminating (SIGTERM) 20:20:09.233848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23552): Terminating (SIGTERM) 20:20:09.276492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23555): Terminating (SIGTERM) 20:20:09.318865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23558): Terminating (SIGTERM) 20:20:09.361756 --- ParallelTerminationStrategy: PID 23548 died... 20:20:09.381925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23548): Terminated: ok {rc=0} 20:20:09.429562 --- ParallelTerminationStrategy: PID 23549 died... 20:20:09.449496 run iperf3-srv_10.42.42.10(pid=23549): Terminated {rc=256} 20:20:09.496802 --- ParallelTerminationStrategy: PID 23552 died... 20:20:09.517357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23552): Terminated: ok {rc=0} 20:20:09.564565 --- ParallelTerminationStrategy: PID 23555 died... 20:20:09.584530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23555): Terminated: ok {rc=0} 20:20:09.631701 --- ParallelTerminationStrategy: PID 23558 died... 20:20:09.651687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23558): Terminated: ok {rc=0} 20:20:09.739796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:20:10.887251 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:10.899100 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:10.948723 tst iperf3m4.py: using LAC 31264 20:20:11.069474 tst iperf3m4.py: using RAC 154 20:20:11.189988 tst iperf3m4.py: using CellId 31264 20:20:11.309363 tst iperf3m4.py: using BVCI 31265 20:20:11.419246 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.430384 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.441353 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.452135 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.462908 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.473656 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.484593 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.495517 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:11.506461 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:11.621724 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:11.747352 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:11.869969 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:11.993375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:20:12.215709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:12.545357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23563): Launched 20:20:12.832576 run iperf3-srv_10.42.42.10(pid=23564): Launched 20:20:12.957478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:20:13.176683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:13.506733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23565): Launched 20:20:13.792477 run iperf3-srv_10.42.42.10(pid=23566): Launched 20:20:13.917725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:20:14.138946 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:14.469592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23567): Launched 20:20:14.755279 run iperf3-srv_10.42.42.10(pid=23568): Launched 20:20:14.879755 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:20:15.100699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:15.431619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23569): Launched 20:20:15.717799 run iperf3-srv_10.42.42.10(pid=23570): Launched 20:20:15.846752 tst iperf3m4.py:8: start network... 20:20:16.076736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:16.587198 run create_hlr_db(pid=23571): Launched 20:20:16.752032 bus /gobi_6: Setting Powered False 20:20:17.813916 run create_hlr_db(pid=23571): Terminated: ok {rc=0} 20:20:18.238893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23573): Launched 20:20:18.543844 run osmo-hlr_10.42.42.2(pid=23574): Launched 20:20:18.659682 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:19.198723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23576): Launched 20:20:19.508155 run osmo-stp_10.42.42.5(pid=23577): Launched 20:20:19.623845 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:20.147534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23579): Launched 20:20:20.265649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:20.522530 run patchelf(pid=23580): Launched 20:20:20.693826 run osmo-stp_10.42.42.5(pid=23577): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23577)] 20:20:20.822319 run osmo-stp_10.42.42.5(pid=23577): stdout: | (launched: 2022-12-12_20:20:19.451167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:20.952895 run osmo-stp_10.42.42.5(pid=23577): stderr: | 20221212202019621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202019621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202019622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202019622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202019622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202019623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202019623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:21.083136 run osmo-stp_10.42.42.5(pid=23577): stdout: | (launched: 2022-12-12_20:20:19.451167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:21.207262 run osmo-stp_10.42.42.5(pid=23577): stderr: | 20221212202019621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202019621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202019622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202019622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202019622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202019623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202019623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:21.355542 run patchelf(pid=23580): Terminating (SIGINT) 20:20:21.525723 run patchelf(pid=23580): Terminated: ok {rc=0} 20:20:21.648485 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23577): Process ended prematurely: osmo-stp_10.42.42.5(pid=23577) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23577)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 20:20:21.658149 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:20:21.686151 run osmo-hlr_10.42.42.2(pid=23574): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23574)] 20:20:21.733933 run osmo-hlr_10.42.42.2(pid=23574): stdout: | (launched: 2022-12-12_20:20:18.487130) 20:20:21.783676 run osmo-hlr_10.42.42.2(pid=23574): stderr: | 20221212202018658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202018658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202018658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202018659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202018659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202018659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202018671 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202018679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202018680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202018680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:21.834021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23563): Terminating (SIGTERM) 20:20:21.874110 run iperf3-srv_10.42.42.10(pid=23564): Terminating (SIGTERM) 20:20:21.914192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23565): Terminating (SIGTERM) 20:20:21.954084 run iperf3-srv_10.42.42.10(pid=23566): Terminating (SIGTERM) 20:20:21.993759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23567): Terminating (SIGTERM) 20:20:22.033553 run iperf3-srv_10.42.42.10(pid=23568): Terminating (SIGTERM) 20:20:22.073389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23569): Terminating (SIGTERM) 20:20:22.113194 run iperf3-srv_10.42.42.10(pid=23570): Terminating (SIGTERM) 20:20:22.152789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23573): Terminating (SIGTERM) 20:20:22.192404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23576): Terminating (SIGTERM) 20:20:22.232176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23579): Terminating (SIGTERM) 20:20:22.272465 --- ParallelTerminationStrategy: PID 23563 died... 20:20:22.291966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23563): Terminated: ok {rc=0} 20:20:22.336204 --- ParallelTerminationStrategy: PID 23564 died... 20:20:22.354823 run iperf3-srv_10.42.42.10(pid=23564): Terminated {rc=256} 20:20:22.398978 --- ParallelTerminationStrategy: PID 23565 died... 20:20:22.417580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23565): Terminated: ok {rc=0} 20:20:22.462009 --- ParallelTerminationStrategy: PID 23566 died... 20:20:22.480813 run iperf3-srv_10.42.42.10(pid=23566): Terminated {rc=256} 20:20:22.524614 --- ParallelTerminationStrategy: PID 23567 died... 20:20:22.543730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23567): Terminated: ok {rc=0} 20:20:22.587618 --- ParallelTerminationStrategy: PID 23568 died... 20:20:22.606420 run iperf3-srv_10.42.42.10(pid=23568): Terminated {rc=256} 20:20:22.650240 --- ParallelTerminationStrategy: PID 23569 died... 20:20:22.668768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23569): Terminated: ok {rc=0} 20:20:22.713017 --- ParallelTerminationStrategy: PID 23570 died... 20:20:22.731784 run iperf3-srv_10.42.42.10(pid=23570): Terminated {rc=256} 20:20:22.775483 --- ParallelTerminationStrategy: PID 23573 died... 20:20:22.794188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23573): Terminated: ok {rc=0} 20:20:22.837980 --- ParallelTerminationStrategy: PID 23576 died... 20:20:22.856585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23576): Terminated: ok {rc=0} 20:20:22.901055 --- ParallelTerminationStrategy: PID 23579 died... 20:20:22.919968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23579): Terminated: ok {rc=0} 20:20:23.003797 bus /gobi_4: Setting Powered False 20:20:24.103435 bus /gobi_4: Setting Powered False 20:20:25.221656 bus /gobi_1: Setting Powered False 20:20:26.318055 bus /gobi_1: Setting Powered False 20:20:27.433501 bus /gobi_0: Setting Powered False 20:20:28.533103 bus /gobi_0: Setting Powered False 20:20:29.647147 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 20:20:30.749673 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:30.762176 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:30.813727 tst ping.py: using LAC 31265 20:20:30.963665 tst ping.py: using RAC 155 20:20:31.091396 tst ping.py: using CellId 31265 20:20:31.249999 tst ping.py: using BVCI 31266 20:20:31.362622 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:31.374491 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:31.386169 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:31.398266 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:31.410787 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:31.423665 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:31.435945 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:31.447593 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:31.565284 tst ping.py:19: start network... 20:20:31.769721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:32.243360 run create_hlr_db(pid=23581): Launched 20:20:32.370027 bus /gobi_6: Setting Powered False 20:20:33.434474 run create_hlr_db(pid=23581): Terminated: ok {rc=0} 20:20:33.865113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Launched 20:20:34.164591 run osmo-hlr_10.42.42.2(pid=23584): Launched 20:20:34.278365 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:34.796472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23586): Launched 20:20:35.095731 run osmo-stp_10.42.42.5(pid=23587): Launched 20:20:35.209196 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:35.725829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23589): Launched 20:20:35.840727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:36.093871 run patchelf(pid=23590): Launched 20:20:36.260230 run osmo-stp_10.42.42.5(pid=23587): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23587)] 20:20:36.387561 run osmo-stp_10.42.42.5(pid=23587): stdout: | (launched: 2022-12-12_20:20:35.039986) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:36.515979 run osmo-stp_10.42.42.5(pid=23587): stderr: | 20221212202035208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202035208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202035208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202035209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202035209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202035209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202035209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:36.644793 run osmo-stp_10.42.42.5(pid=23587): stdout: | (launched: 2022-12-12_20:20:35.039986) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:36.767438 run osmo-stp_10.42.42.5(pid=23587): stderr: | 20221212202035208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202035208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202035208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202035209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202035209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202035209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202035209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:36.912540 run patchelf(pid=23590): Terminating (SIGINT) 20:20:37.079449 run patchelf(pid=23590): Terminated: ok {rc=0} 20:20:37.200070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23587): Process ended prematurely: osmo-stp_10.42.42.5(pid=23587) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23587)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 20:20:37.209077 tst ping.py:22: Test FAILED (6.5 sec) 20:20:37.236072 run osmo-hlr_10.42.42.2(pid=23584): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23584)] 20:20:37.283444 run osmo-hlr_10.42.42.2(pid=23584): stdout: | (launched: 2022-12-12_20:20:34.109235) 20:20:37.332808 run osmo-hlr_10.42.42.2(pid=23584): stderr: | 20221212202034281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202034281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202034281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202034281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202034281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202034282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202034295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202034305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202034305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202034306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:37.382550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Terminating (SIGTERM) 20:20:37.422352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23586): Terminating (SIGTERM) 20:20:37.462412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23589): Terminating (SIGTERM) 20:20:37.502859 --- ParallelTerminationStrategy: PID 23583 died... 20:20:37.522181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Terminated: ok {rc=0} 20:20:37.566590 --- ParallelTerminationStrategy: PID 23586 died... 20:20:37.585322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23586): Terminated: ok {rc=0} 20:20:37.629284 --- ParallelTerminationStrategy: PID 23589 died... 20:20:37.647869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23589): Terminated: ok {rc=0} 20:20:37.731757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:20:38.817045 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:38.828892 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:38.879599 tst ping_idle_ping.py: using LAC 31266 20:20:38.997474 tst ping_idle_ping.py: using RAC 156 20:20:39.114203 tst ping_idle_ping.py: using CellId 31266 20:20:39.231291 tst ping_idle_ping.py: using BVCI 31267 20:20:39.339297 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:39.350518 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:39.361468 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:39.372259 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:39.382994 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:39.393737 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:39.404692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:39.415471 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:39.533505 tst ping_idle_ping.py:24: start network... 20:20:39.733870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:40.201508 run create_hlr_db(pid=23591): Launched 20:20:40.324354 bus /gobi_6: Setting Powered False 20:20:41.385220 run create_hlr_db(pid=23591): Terminated: ok {rc=0} 20:20:41.828479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23593): Launched 20:20:42.153240 run osmo-hlr_10.42.42.2(pid=23594): Launched 20:20:42.277842 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:42.832397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23596): Launched 20:20:43.154507 run osmo-stp_10.42.42.5(pid=23597): Launched 20:20:43.280770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:43.836801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23599): Launched 20:20:43.961272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:44.234013 run patchelf(pid=23600): Launched 20:20:44.414108 run osmo-stp_10.42.42.5(pid=23597): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23597)] 20:20:44.549802 run osmo-stp_10.42.42.5(pid=23597): stdout: | (launched: 2022-12-12_20:20:43.095096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:44.687739 run osmo-stp_10.42.42.5(pid=23597): stderr: | 20221212202043282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202043282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202043282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202043282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202043283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202043283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202043283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:44.826111 run osmo-stp_10.42.42.5(pid=23597): stdout: | (launched: 2022-12-12_20:20:43.095096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:44.957692 run osmo-stp_10.42.42.5(pid=23597): stderr: | 20221212202043282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202043282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202043282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202043282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202043283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202043283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202043283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:45.114142 run patchelf(pid=23600): Terminating (SIGINT) 20:20:45.294750 run patchelf(pid=23600): Terminated: ok {rc=0} 20:20:45.424621 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23597): Process ended prematurely: osmo-stp_10.42.42.5(pid=23597) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23597)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 20:20:45.434341 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:20:45.463277 run osmo-hlr_10.42.42.2(pid=23594): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23594)] 20:20:45.514022 run osmo-hlr_10.42.42.2(pid=23594): stdout: | (launched: 2022-12-12_20:20:42.093433) 20:20:45.567231 run osmo-hlr_10.42.42.2(pid=23594): stderr: | 20221212202042286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202042286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202042286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202042286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202042286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202042286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202042299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202042309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202042309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202042309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:45.620183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23593): Terminating (SIGTERM) 20:20:45.662555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23596): Terminating (SIGTERM) 20:20:45.704927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23599): Terminating (SIGTERM) 20:20:45.747321 --- ParallelTerminationStrategy: PID 23593 died... 20:20:45.767660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23593): Terminated: ok {rc=0} 20:20:45.814830 --- ParallelTerminationStrategy: PID 23596 died... 20:20:45.839259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23596): Terminated: ok {rc=0} 20:20:45.888298 --- ParallelTerminationStrategy: PID 23599 died... 20:20:45.908605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23599): Terminated: ok {rc=0} 20:20:46.001308 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:20:47.345315 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:20:47.352573 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:20:47.385964 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:20:47.424495 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:20:47.511363 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:20:47.543837 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:20:47.582226 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:20:48.177277 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:20:48.226353 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.237560 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:20:48.304042 tst cs_paging_gprs_active.py: using LAC 31267 20:20:48.425256 tst cs_paging_gprs_active.py: using RAC 157 20:20:48.543880 tst cs_paging_gprs_active.py: using CellId 31267 20:20:48.664399 tst cs_paging_gprs_active.py: using BVCI 31268 20:20:48.775360 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.786410 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.797239 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.808031 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.818848 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.829646 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.840465 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.851147 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:48.862107 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:48.976258 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:49.095500 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:20:49.318546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:49.648265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23605): Launched 20:20:49.934804 run iperf3-srv_10.42.42.10(pid=23606): Launched 20:20:50.057701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:20:50.279042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:50.607523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23607): Launched 20:20:50.895088 run iperf3-srv_10.42.42.10(pid=23608): Launched 20:20:51.019106 tst cs_paging_gprs_active.py:38: start network... 20:20:51.239250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:51.745441 run create_hlr_db(pid=23609): Launched 20:20:51.870863 bus /gobi_6: Setting Powered False 20:20:52.935615 run create_hlr_db(pid=23609): Terminated: ok {rc=0} 20:20:53.372120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23611): Launched 20:20:53.678915 run osmo-hlr_10.42.42.2(pid=23612): Launched 20:20:53.797471 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:54.320269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23614): Launched 20:20:54.626234 run osmo-stp_10.42.42.5(pid=23615): Launched 20:20:54.743201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:55.267873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23617): Launched 20:20:55.385604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:55.644469 run patchelf(pid=23618): Launched 20:20:55.814902 run osmo-stp_10.42.42.5(pid=23615): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23615)] 20:20:55.944410 run osmo-stp_10.42.42.5(pid=23615): stdout: | (launched: 2022-12-12_20:20:54.569811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:56.075081 run osmo-stp_10.42.42.5(pid=23615): stderr: | 20221212202054735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202054735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202054736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202054736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202054737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202054737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202054737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:56.206099 run osmo-stp_10.42.42.5(pid=23615): stdout: | (launched: 2022-12-12_20:20:54.569811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:56.330827 run osmo-stp_10.42.42.5(pid=23615): stderr: | 20221212202054735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202054735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202054736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202054736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202054737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202054737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202054737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:56.478817 run patchelf(pid=23618): Terminating (SIGINT) 20:20:56.649805 run patchelf(pid=23618): Terminated: ok {rc=0} 20:20:56.773613 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23615): Process ended prematurely: osmo-stp_10.42.42.5(pid=23615) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23615)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:20:56.783062 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:20:56.810723 run osmo-hlr_10.42.42.2(pid=23612): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23612)] 20:20:56.858488 run osmo-hlr_10.42.42.2(pid=23612): stdout: | (launched: 2022-12-12_20:20:53.622203) 20:20:56.908111 run osmo-hlr_10.42.42.2(pid=23612): stderr: | 20221212202053795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202053795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202053795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202053795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202053795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202053795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202053807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202053817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202053817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202053817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:56.958345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23605): Terminating (SIGTERM) 20:20:56.998120 run iperf3-srv_10.42.42.10(pid=23606): Terminating (SIGTERM) 20:20:57.037817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23607): Terminating (SIGTERM) 20:20:57.077658 run iperf3-srv_10.42.42.10(pid=23608): Terminating (SIGTERM) 20:20:57.118725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23611): Terminating (SIGTERM) 20:20:57.158982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23614): Terminating (SIGTERM) 20:20:57.198984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23617): Terminating (SIGTERM) 20:20:57.239026 --- ParallelTerminationStrategy: PID 23605 died... 20:20:57.258372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23605): Terminated: ok {rc=0} 20:20:57.303026 --- ParallelTerminationStrategy: PID 23606 died... 20:20:57.321734 run iperf3-srv_10.42.42.10(pid=23606): Terminated {rc=256} 20:20:57.365692 --- ParallelTerminationStrategy: PID 23607 died... 20:20:57.384354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23607): Terminated: ok {rc=0} 20:20:57.428092 --- ParallelTerminationStrategy: PID 23608 died... 20:20:57.446781 run iperf3-srv_10.42.42.10(pid=23608): Terminated {rc=256} 20:20:57.490394 --- ParallelTerminationStrategy: PID 23611 died... 20:20:57.509091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23611): Terminated: ok {rc=0} 20:20:57.553524 --- ParallelTerminationStrategy: PID 23614 died... 20:20:57.572086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23614): Terminated: ok {rc=0} 20:20:57.616641 --- ParallelTerminationStrategy: PID 23617 died... 20:20:57.635592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23617): Terminated: ok {rc=0} 20:20:57.721268 bus /gobi_0: Setting Powered False 20:20:58.822064 bus /gobi_0: Setting Powered False 20:20:59.935823 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:21:01.103967 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.119382 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:01.202157 tst iperf3.py: using LAC 31268 20:21:01.335423 tst iperf3.py: using RAC 158 20:21:01.506876 tst iperf3.py: using CellId 31268 20:21:01.632598 tst iperf3.py: using BVCI 31269 20:21:01.782936 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.797701 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.812439 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.827753 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.841865 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.856849 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.871079 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.885588 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:01.899820 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:02.020872 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:21:02.259286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:02.593499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23619): Launched 20:21:02.879513 run iperf3-srv_10.42.42.10(pid=23620): Launched 20:21:03.004791 tst iperf3.py:8: start network... 20:21:03.225298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:03.733157 run create_hlr_db(pid=23621): Launched 20:21:03.859884 bus /gobi_6: Setting Powered False 20:21:04.923923 run create_hlr_db(pid=23621): Terminated: ok {rc=0} 20:21:05.379520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23623): Launched 20:21:05.710190 run osmo-hlr_10.42.42.2(pid=23624): Launched 20:21:05.835712 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:06.398436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23626): Launched 20:21:06.726970 run osmo-stp_10.42.42.5(pid=23627): Launched 20:21:06.851797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:07.415471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23629): Launched 20:21:07.542199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:07.819295 run patchelf(pid=23630): Launched 20:21:08.002586 run osmo-stp_10.42.42.5(pid=23627): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23627)] 20:21:08.140849 run osmo-stp_10.42.42.5(pid=23627): stdout: | (launched: 2022-12-12_20:21:06.666942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:08.281415 run osmo-stp_10.42.42.5(pid=23627): stderr: | 20221212202106854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202106854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202106854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202106855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202106855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202106855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202106855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:08.421797 run osmo-stp_10.42.42.5(pid=23627): stdout: | (launched: 2022-12-12_20:21:06.666942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:08.555633 run osmo-stp_10.42.42.5(pid=23627): stderr: | 20221212202106854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202106854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202106854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202106855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202106855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202106855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202106855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:08.714395 run patchelf(pid=23630): Terminating (SIGINT) 20:21:08.896829 run patchelf(pid=23630): Terminated: ok {rc=0} 20:21:09.028878 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23627): Process ended prematurely: osmo-stp_10.42.42.5(pid=23627) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23627)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 20:21:09.039207 tst iperf3.py:8: Test FAILED (8.0 sec) 20:21:09.068603 run osmo-hlr_10.42.42.2(pid=23624): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23624)] 20:21:09.119441 run osmo-hlr_10.42.42.2(pid=23624): stdout: | (launched: 2022-12-12_20:21:05.649464) 20:21:09.171980 run osmo-hlr_10.42.42.2(pid=23624): stderr: | 20221212202105845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202105845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202105845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202105845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202105845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202105845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202105858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202105866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202105867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202105867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:09.225343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23619): Terminating (SIGTERM) 20:21:09.268045 run iperf3-srv_10.42.42.10(pid=23620): Terminating (SIGTERM) 20:21:09.310402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23623): Terminating (SIGTERM) 20:21:09.352874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23626): Terminating (SIGTERM) 20:21:09.395206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23629): Terminating (SIGTERM) 20:21:09.437740 --- ParallelTerminationStrategy: PID 23619 died... 20:21:09.457974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23619): Terminated: ok {rc=0} 20:21:09.505362 --- ParallelTerminationStrategy: PID 23620 died... 20:21:09.525192 run iperf3-srv_10.42.42.10(pid=23620): Terminated {rc=256} 20:21:09.572550 --- ParallelTerminationStrategy: PID 23623 died... 20:21:09.592489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23623): Terminated: ok {rc=0} 20:21:09.639510 --- ParallelTerminationStrategy: PID 23626 died... 20:21:09.659521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23626): Terminated: ok {rc=0} 20:21:09.706554 --- ParallelTerminationStrategy: PID 23629 died... 20:21:09.726488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23629): Terminated: ok {rc=0} 20:21:09.814528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:21:10.962430 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:10.974306 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:11.040555 tst iperf3m4.py: using LAC 31269 20:21:11.168584 tst iperf3m4.py: using RAC 159 20:21:11.296651 tst iperf3m4.py: using CellId 31269 20:21:11.425349 tst iperf3m4.py: using BVCI 31270 20:21:11.543541 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.555070 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.566773 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.578484 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.590133 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.601814 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.613639 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.625216 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:11.636851 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:11.757784 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:11.880884 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:11.997699 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:12.116556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:21:12.337506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:12.666462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23631): Launched 20:21:12.952324 run iperf3-srv_10.42.42.10(pid=23632): Launched 20:21:13.077153 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:21:13.298258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:13.627119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23633): Launched 20:21:13.913157 run iperf3-srv_10.42.42.10(pid=23634): Launched 20:21:14.035651 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:21:14.256648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:14.586749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23635): Launched 20:21:14.872558 run iperf3-srv_10.42.42.10(pid=23636): Launched 20:21:14.997268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:21:15.217117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:15.547078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23637): Launched 20:21:15.833955 run iperf3-srv_10.42.42.10(pid=23638): Launched 20:21:15.994564 tst iperf3m4.py:8: start network... 20:21:16.219137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:16.735623 run create_hlr_db(pid=23639): Launched 20:21:16.899151 bus /gobi_6: Setting Powered False 20:21:17.963493 run create_hlr_db(pid=23639): Terminated: ok {rc=0} 20:21:18.419935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23641): Launched 20:21:18.750070 run osmo-hlr_10.42.42.2(pid=23642): Launched 20:21:18.875701 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:19.438618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23644): Launched 20:21:19.766253 run osmo-stp_10.42.42.5(pid=23645): Launched 20:21:19.893698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:20.457897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23647): Launched 20:21:20.583929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:20.860059 run patchelf(pid=23648): Launched 20:21:21.043177 run osmo-stp_10.42.42.5(pid=23645): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23645)] 20:21:21.182100 run osmo-stp_10.42.42.5(pid=23645): stdout: | (launched: 2022-12-12_20:21:19.705777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:21.322363 run osmo-stp_10.42.42.5(pid=23645): stderr: | 20221212202119893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202119893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202119894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202119894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202119895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202119895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202119895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:21.462392 run osmo-stp_10.42.42.5(pid=23645): stdout: | (launched: 2022-12-12_20:21:19.705777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:21.595803 run osmo-stp_10.42.42.5(pid=23645): stderr: | 20221212202119893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202119893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202119894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202119894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202119895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202119895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202119895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:21.754245 run patchelf(pid=23648): Terminating (SIGINT) 20:21:21.940608 run patchelf(pid=23648): Terminated: ok {rc=0} 20:21:22.073056 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23645): Process ended prematurely: osmo-stp_10.42.42.5(pid=23645) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23645)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:21:22.083630 tst iperf3m4.py:8: Test FAILED (11.2 sec) 20:21:22.113589 run osmo-hlr_10.42.42.2(pid=23642): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23642)] 20:21:22.164078 run osmo-hlr_10.42.42.2(pid=23642): stdout: | (launched: 2022-12-12_20:21:18.689641) 20:21:22.216517 run osmo-hlr_10.42.42.2(pid=23642): stderr: | 20221212202118885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202118885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202118885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202118885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202118885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202118885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202118902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202118910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202118910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202118910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:22.269775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23631): Terminating (SIGTERM) 20:21:22.312128 run iperf3-srv_10.42.42.10(pid=23632): Terminating (SIGTERM) 20:21:22.354541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23633): Terminating (SIGTERM) 20:21:22.396742 run iperf3-srv_10.42.42.10(pid=23634): Terminating (SIGTERM) 20:21:22.438736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23635): Terminating (SIGTERM) 20:21:22.480876 run iperf3-srv_10.42.42.10(pid=23636): Terminating (SIGTERM) 20:21:22.523151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23637): Terminating (SIGTERM) 20:21:22.565282 run iperf3-srv_10.42.42.10(pid=23638): Terminating (SIGTERM) 20:21:22.607283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23641): Terminating (SIGTERM) 20:21:22.649389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23644): Terminating (SIGTERM) 20:21:22.691726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23647): Terminating (SIGTERM) 20:21:22.734531 --- ParallelTerminationStrategy: PID 23631 died... 20:21:22.754816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23631): Terminated: ok {rc=0} 20:21:22.802352 --- ParallelTerminationStrategy: PID 23632 died... 20:21:22.822102 run iperf3-srv_10.42.42.10(pid=23632): Terminated {rc=256} 20:21:22.868807 --- ParallelTerminationStrategy: PID 23633 died... 20:21:22.888891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23633): Terminated: ok {rc=0} 20:21:22.936028 --- ParallelTerminationStrategy: PID 23634 died... 20:21:22.955818 run iperf3-srv_10.42.42.10(pid=23634): Terminated {rc=256} 20:21:23.002955 --- ParallelTerminationStrategy: PID 23635 died... 20:21:23.022569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23635): Terminated: ok {rc=0} 20:21:23.069617 --- ParallelTerminationStrategy: PID 23636 died... 20:21:23.089393 run iperf3-srv_10.42.42.10(pid=23636): Terminated {rc=256} 20:21:23.135848 --- ParallelTerminationStrategy: PID 23637 died... 20:21:23.155550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23637): Terminated: ok {rc=0} 20:21:23.202595 --- ParallelTerminationStrategy: PID 23638 died... 20:21:23.222206 run iperf3-srv_10.42.42.10(pid=23638): Terminated {rc=256} 20:21:23.269368 --- ParallelTerminationStrategy: PID 23641 died... 20:21:23.289040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23641): Terminated: ok {rc=0} 20:21:23.336034 --- ParallelTerminationStrategy: PID 23644 died... 20:21:23.355784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23644): Terminated: ok {rc=0} 20:21:23.402903 --- ParallelTerminationStrategy: PID 23647 died... 20:21:23.422796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23647): Terminated: ok {rc=0} 20:21:23.511381 bus /gobi_4: Setting Powered False 20:21:24.611838 bus /gobi_4: Setting Powered False 20:21:25.728874 bus /gobi_1: Setting Powered False 20:21:26.829265 bus /gobi_1: Setting Powered False 20:21:27.947642 bus /gobi_0: Setting Powered False 20:21:29.046348 bus /gobi_0: Setting Powered False 20:21:30.166378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:21:31.272863 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:31.286042 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:31.354243 tst ping.py: using LAC 31270 20:21:31.522466 tst ping.py: using RAC 160 20:21:31.678606 tst ping.py: using CellId 31270 20:21:31.806926 tst ping.py: using BVCI 31271 20:21:31.928249 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:31.940919 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:31.953569 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:31.966684 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:31.981294 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:31.995035 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:32.008861 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:32.021492 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:32.144625 tst ping.py:19: start network... 20:21:32.366699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:32.865121 run create_hlr_db(pid=23649): Launched 20:21:32.988409 bus /gobi_6: Setting Powered False 20:21:34.052448 run create_hlr_db(pid=23649): Terminated: ok {rc=0} 20:21:34.483467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Launched 20:21:34.783524 run osmo-hlr_10.42.42.2(pid=23652): Launched 20:21:34.898041 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:35.414818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Launched 20:21:35.715148 run osmo-stp_10.42.42.5(pid=23655): Launched 20:21:35.828524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:36.344625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23657): Launched 20:21:36.459515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:36.713386 run patchelf(pid=23658): Launched 20:21:36.880452 run osmo-stp_10.42.42.5(pid=23655): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] 20:21:37.006832 run osmo-stp_10.42.42.5(pid=23655): stdout: | (launched: 2022-12-12_20:21:35.658998) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:37.135242 run osmo-stp_10.42.42.5(pid=23655): stderr: | 20221212202135825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202135825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202135825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202135826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202135826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202135826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202135827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:37.263674 run osmo-stp_10.42.42.5(pid=23655): stdout: | (launched: 2022-12-12_20:21:35.658998) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:37.386171 run osmo-stp_10.42.42.5(pid=23655): stderr: | 20221212202135825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202135825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202135825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202135826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202135826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202135826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202135827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:37.531263 run patchelf(pid=23658): Terminating (SIGINT) 20:21:37.699033 run patchelf(pid=23658): Terminated: ok {rc=0} 20:21:37.820099 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23655): Process ended prematurely: osmo-stp_10.42.42.5(pid=23655) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 20:21:37.828927 tst ping.py:22: Test FAILED (6.5 sec) 20:21:37.855991 run osmo-hlr_10.42.42.2(pid=23652): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23652)] 20:21:37.903867 run osmo-hlr_10.42.42.2(pid=23652): stdout: | (launched: 2022-12-12_20:21:34.727921) 20:21:37.953846 run osmo-hlr_10.42.42.2(pid=23652): stderr: | 20221212202134899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202134899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202134899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202134899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202134899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202134899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202134914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202134924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202134925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202134926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:38.003744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Terminating (SIGTERM) 20:21:38.043188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Terminating (SIGTERM) 20:21:38.082771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23657): Terminating (SIGTERM) 20:21:38.122821 --- ParallelTerminationStrategy: PID 23651 died... 20:21:38.142272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23651): Terminated: ok {rc=0} 20:21:38.186741 --- ParallelTerminationStrategy: PID 23654 died... 20:21:38.205814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23654): Terminated: ok {rc=0} 20:21:38.250674 --- ParallelTerminationStrategy: PID 23657 died... 20:21:38.269734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23657): Terminated: ok {rc=0} 20:21:38.356554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:21:39.446061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:39.458006 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:39.525777 tst ping_idle_ping.py: using LAC 31271 20:21:39.645484 tst ping_idle_ping.py: using RAC 161 20:21:39.763166 tst ping_idle_ping.py: using CellId 31271 20:21:39.880794 tst ping_idle_ping.py: using BVCI 31272 20:21:39.991329 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:40.002422 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:40.013375 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:40.024266 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:40.035082 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:40.045933 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:40.056900 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:40.067788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:40.182101 tst ping_idle_ping.py:24: start network... 20:21:40.383408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:40.854687 run create_hlr_db(pid=23659): Launched 20:21:40.980330 bus /gobi_6: Setting Powered False 20:21:42.041524 run create_hlr_db(pid=23659): Terminated: ok {rc=0} 20:21:42.483564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Launched 20:21:42.808872 run osmo-hlr_10.42.42.2(pid=23662): Launched 20:21:42.933346 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:43.486959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Launched 20:21:43.810759 run osmo-stp_10.42.42.5(pid=23665): Launched 20:21:43.935403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:44.493152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23667): Launched 20:21:44.616876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:44.890320 run patchelf(pid=23668): Launched 20:21:45.071444 run osmo-stp_10.42.42.5(pid=23665): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] 20:21:45.207908 run osmo-stp_10.42.42.5(pid=23665): stdout: | (launched: 2022-12-12_20:21:43.751308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:45.347041 run osmo-stp_10.42.42.5(pid=23665): stderr: | 20221212202143938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202143938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202143939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202143939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202143940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202143940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202143940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:45.485528 run osmo-stp_10.42.42.5(pid=23665): stdout: | (launched: 2022-12-12_20:21:43.751308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:45.618106 run osmo-stp_10.42.42.5(pid=23665): stderr: | 20221212202143938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202143938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202143939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202143939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202143940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202143940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202143940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:45.775217 run patchelf(pid=23668): Terminating (SIGINT) 20:21:45.971966 run patchelf(pid=23668): Terminated: ok {rc=0} 20:21:46.129215 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23665): Process ended prematurely: osmo-stp_10.42.42.5(pid=23665) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:21:46.144283 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:21:46.173660 run osmo-hlr_10.42.42.2(pid=23662): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23662)] 20:21:46.223253 run osmo-hlr_10.42.42.2(pid=23662): stdout: | (launched: 2022-12-12_20:21:42.749047) 20:21:46.275432 run osmo-hlr_10.42.42.2(pid=23662): stderr: | 20221212202142944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202142944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202142944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202142944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202142944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202142944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202142956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202142964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202142965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202142965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:46.327801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Terminating (SIGTERM) 20:21:46.370143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Terminating (SIGTERM) 20:21:46.413559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23667): Terminating (SIGTERM) 20:21:46.457604 --- ParallelTerminationStrategy: PID 23661 died... 20:21:46.477688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Terminated: ok {rc=0} 20:21:46.526495 --- ParallelTerminationStrategy: PID 23664 died... 20:21:46.546175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Terminated: ok {rc=0} 20:21:46.592265 --- ParallelTerminationStrategy: PID 23667 died... 20:21:46.612145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23667): Terminated: ok {rc=0} 20:21:46.705110 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:21:48.036451 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:21:48.044219 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:21:48.077904 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 20:21:48.117428 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 20:21:48.207189 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:21:48.238911 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 20:21:48.276696 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 20:21:48.876221 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 20:21:48.925467 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:48.937316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:21:48.985944 tst cs_paging_gprs_active.py: using LAC 31272 20:21:49.105731 tst cs_paging_gprs_active.py: using RAC 162 20:21:49.226007 tst cs_paging_gprs_active.py: using CellId 31272 20:21:49.344451 tst cs_paging_gprs_active.py: using BVCI 31273 20:21:49.455286 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.466870 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.478178 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.490019 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.501120 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.512260 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.523747 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.534991 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:21:49.546303 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:21:49.661618 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:21:49.775175 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:21:49.977670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:50.280344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23673): Launched 20:21:50.544694 run iperf3-srv_10.42.42.10(pid=23674): Launched 20:21:50.657898 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:21:50.858666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:51.161466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23675): Launched 20:21:51.425038 run iperf3-srv_10.42.42.10(pid=23676): Launched 20:21:51.538537 tst cs_paging_gprs_active.py:38: start network... 20:21:51.740198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:52.209476 run create_hlr_db(pid=23677): Launched 20:21:52.333545 bus /gobi_6: Setting Powered False 20:21:53.397734 run create_hlr_db(pid=23677): Terminated: ok {rc=0} 20:21:53.849675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23679): Launched 20:21:54.173689 run osmo-hlr_10.42.42.2(pid=23680): Launched 20:21:54.298156 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:54.854697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23682): Launched 20:21:55.179732 run osmo-stp_10.42.42.5(pid=23683): Launched 20:21:55.304144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:55.863072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23685): Launched 20:21:55.987524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:56.262317 run patchelf(pid=23686): Launched 20:21:56.443439 run osmo-stp_10.42.42.5(pid=23683): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23683)] 20:21:56.581198 run osmo-stp_10.42.42.5(pid=23683): stdout: | (launched: 2022-12-12_20:21:55.120317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:56.720082 run osmo-stp_10.42.42.5(pid=23683): stderr: | 20221212202155309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202155309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202155310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202155310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202155311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202155311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202155311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:56.859410 run osmo-stp_10.42.42.5(pid=23683): stdout: | (launched: 2022-12-12_20:21:55.120317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:56.991875 run osmo-stp_10.42.42.5(pid=23683): stderr: | 20221212202155309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202155309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202155310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202155310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202155311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202155311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202155311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:57.149315 run patchelf(pid=23686): Terminating (SIGINT) 20:21:57.331694 run patchelf(pid=23686): Terminated: ok {rc=0} 20:21:57.462886 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23683): Process ended prematurely: osmo-stp_10.42.42.5(pid=23683) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23683)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 20:21:57.473187 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:21:57.502540 run osmo-hlr_10.42.42.2(pid=23680): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23680)] 20:21:57.553265 run osmo-hlr_10.42.42.2(pid=23680): stdout: | (launched: 2022-12-12_20:21:54.114171) 20:21:57.605977 run osmo-hlr_10.42.42.2(pid=23680): stderr: | 20221212202154308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202154308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202154308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202154308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202154308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202154308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202154320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202154330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202154330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202154330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:57.658984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23673): Terminating (SIGTERM) 20:21:57.701145 run iperf3-srv_10.42.42.10(pid=23674): Terminating (SIGTERM) 20:21:57.743254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23675): Terminating (SIGTERM) 20:21:57.785468 run iperf3-srv_10.42.42.10(pid=23676): Terminating (SIGTERM) 20:21:57.827516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23679): Terminating (SIGTERM) 20:21:57.869871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23682): Terminating (SIGTERM) 20:21:57.912045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23685): Terminating (SIGTERM) 20:21:57.954394 --- ParallelTerminationStrategy: PID 23673 died... 20:21:57.974403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23673): Terminated: ok {rc=0} 20:21:58.021497 --- ParallelTerminationStrategy: PID 23674 died... 20:21:58.040899 run iperf3-srv_10.42.42.10(pid=23674): Terminated {rc=256} 20:21:58.087714 --- ParallelTerminationStrategy: PID 23675 died... 20:21:58.107408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23675): Terminated: ok {rc=0} 20:21:58.154235 --- ParallelTerminationStrategy: PID 23676 died... 20:21:58.173807 run iperf3-srv_10.42.42.10(pid=23676): Terminated {rc=256} 20:21:58.220667 --- ParallelTerminationStrategy: PID 23679 died... 20:21:58.240200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23679): Terminated: ok {rc=0} 20:21:58.287181 --- ParallelTerminationStrategy: PID 23682 died... 20:21:58.306758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23682): Terminated: ok {rc=0} 20:21:58.353758 --- ParallelTerminationStrategy: PID 23685 died... 20:21:58.373398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23685): Terminated: ok {rc=0} 20:21:58.461306 bus /gobi_0: Setting Powered False 20:21:59.561202 bus /gobi_0: Setting Powered False 20:22:00.678249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 20:22:01.827566 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:01.840364 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:22:01.890410 tst iperf3.py: using LAC 31273 20:22:02.023252 tst iperf3.py: using RAC 163 20:22:02.202264 tst iperf3.py: using CellId 31273 20:22:02.319709 tst iperf3.py: using BVCI 31274 20:22:02.428469 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.440048 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.451415 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.462823 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.474237 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.485456 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.496581 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.507703 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:02.519101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:22:02.640159 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:22:02.858943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:22:03.184240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Launched 20:22:03.466752 run iperf3-srv_10.42.42.10(pid=23688): Launched 20:22:03.588369 tst iperf3.py:8: start network... 20:22:03.805956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:04.307062 run create_hlr_db(pid=23689): Launched 20:22:04.432524 bus /gobi_6: Setting Powered False 20:22:05.496682 run create_hlr_db(pid=23689): Terminated: ok {rc=0} 20:22:05.929481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Launched 20:22:06.232574 run osmo-hlr_10.42.42.2(pid=23692): Launched 20:22:06.347899 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:06.882950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Launched 20:22:07.185643 run osmo-stp_10.42.42.5(pid=23695): Launched 20:22:07.300744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:07.821844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Launched 20:22:07.937471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:08.193658 run patchelf(pid=23698): Launched 20:22:08.362253 run osmo-stp_10.42.42.5(pid=23695): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] 20:22:08.491958 run osmo-stp_10.42.42.5(pid=23695): stdout: | (launched: 2022-12-12_20:22:07.129472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:08.622165 run osmo-stp_10.42.42.5(pid=23695): stderr: | 20221212202207298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202207298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202207298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202207299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202207299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202207299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202207299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:08.751914 run osmo-stp_10.42.42.5(pid=23695): stdout: | (launched: 2022-12-12_20:22:07.129472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:08.875452 run osmo-stp_10.42.42.5(pid=23695): stderr: | 20221212202207298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202207298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202207298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202207299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202207299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202207299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202207299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:09.022357 run patchelf(pid=23698): Terminating (SIGINT) 20:22:09.191825 run patchelf(pid=23698): Terminated: ok {rc=0} 20:22:09.313959 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23695): Process ended prematurely: osmo-stp_10.42.42.5(pid=23695) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 20:22:09.323559 tst iperf3.py:8: Test FAILED (7.5 sec) 20:22:09.350824 run osmo-hlr_10.42.42.2(pid=23692): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23692)] 20:22:09.398560 run osmo-hlr_10.42.42.2(pid=23692): stdout: | (launched: 2022-12-12_20:22:06.176397) 20:22:09.448063 run osmo-hlr_10.42.42.2(pid=23692): stderr: | 20221212202206351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202206351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202206351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202206351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202206351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202206351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202206363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202206372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202206372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202206372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:09.498374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Terminating (SIGTERM) 20:22:09.537888 run iperf3-srv_10.42.42.10(pid=23688): Terminating (SIGTERM) 20:22:09.577573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Terminating (SIGTERM) 20:22:09.617125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Terminating (SIGTERM) 20:22:09.656585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Terminating (SIGTERM) 20:22:09.696270 --- ParallelTerminationStrategy: PID 23687 died... 20:22:09.715329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23687): Terminated: ok {rc=0} 20:22:09.759375 --- ParallelTerminationStrategy: PID 23688 died... 20:22:09.777935 run iperf3-srv_10.42.42.10(pid=23688): Terminated {rc=256} 20:22:09.821547 --- ParallelTerminationStrategy: PID 23691 died... 20:22:09.840306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23691): Terminated: ok {rc=0} 20:22:09.885074 --- ParallelTerminationStrategy: PID 23694 died... 20:22:09.903778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23694): Terminated: ok {rc=0} 20:22:09.947937 --- ParallelTerminationStrategy: PID 23697 died... 20:22:09.967073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23697): Terminated: ok {rc=0} 20:22:10.050610 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 20:22:11.201695 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.214400 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:22:11.269238 tst iperf3m4.py: using LAC 31274 20:22:11.395900 tst iperf3m4.py: using RAC 164 20:22:11.522793 tst iperf3m4.py: using CellId 31274 20:22:11.649497 tst iperf3m4.py: using BVCI 31275 20:22:11.759488 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.771088 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.782622 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.794267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.805863 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.817533 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.829214 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.840603 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:11.852150 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:22:11.968075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:22:12.087418 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:22:12.206846 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:22:12.326887 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:22:12.546591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:22:12.872037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23699): Launched 20:22:13.154679 run iperf3-srv_10.42.42.10(pid=23700): Launched 20:22:13.276812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:22:13.494621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:22:13.820382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23701): Launched 20:22:14.102210 run iperf3-srv_10.42.42.10(pid=23702): Launched 20:22:14.225289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:22:14.443212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:22:14.768881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23703): Launched 20:22:15.051309 run iperf3-srv_10.42.42.10(pid=23704): Launched 20:22:15.174877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:22:15.392765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:22:15.718199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23705): Launched 20:22:16.015819 run iperf3-srv_10.42.42.10(pid=23706): Launched 20:22:16.152749 tst iperf3m4.py:8: start network... 20:22:16.366501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:16.913458 run create_hlr_db(pid=23707): Launched 20:22:17.080032 bus /gobi_6: Setting Powered False 20:22:18.139680 run create_hlr_db(pid=23707): Terminated: ok {rc=0} 20:22:18.612422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23709): Launched 20:22:18.936678 run osmo-hlr_10.42.42.2(pid=23710): Launched 20:22:19.060564 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:19.622842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23712): Launched 20:22:19.947886 run osmo-stp_10.42.42.5(pid=23713): Launched 20:22:20.071957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:20.632832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23715): Launched 20:22:20.757190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:21.031324 run patchelf(pid=23716): Launched 20:22:21.212118 run osmo-stp_10.42.42.5(pid=23713): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23713)] 20:22:21.350635 run osmo-stp_10.42.42.5(pid=23713): stdout: | (launched: 2022-12-12_20:22:19.888065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:21.490150 run osmo-stp_10.42.42.5(pid=23713): stderr: | 20221212202220076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202220076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202220076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202220076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202220077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202220077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202220077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:21.630323 run osmo-stp_10.42.42.5(pid=23713): stdout: | (launched: 2022-12-12_20:22:19.888065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:21.763529 run osmo-stp_10.42.42.5(pid=23713): stderr: | 20221212202220076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202220076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202220076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202220076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202220077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202220077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202220077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:21.921758 run patchelf(pid=23716): Terminating (SIGINT) 20:22:22.104164 run patchelf(pid=23716): Terminated: ok {rc=0} 20:22:22.236315 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23713): Process ended prematurely: osmo-stp_10.42.42.5(pid=23713) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23713)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 20:22:22.246635 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:22:22.276617 run osmo-hlr_10.42.42.2(pid=23710): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23710)] 20:22:22.328077 run osmo-hlr_10.42.42.2(pid=23710): stdout: | (launched: 2022-12-12_20:22:18.876874) 20:22:22.380557 run osmo-hlr_10.42.42.2(pid=23710): stderr: | 20221212202219070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202219070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202219070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202219070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202219070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202219070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202219084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202219092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202219092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202219092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:22.433749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23699): Terminating (SIGTERM) 20:22:22.475892 run iperf3-srv_10.42.42.10(pid=23700): Terminating (SIGTERM) 20:22:22.518051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23701): Terminating (SIGTERM) 20:22:22.560214 run iperf3-srv_10.42.42.10(pid=23702): Terminating (SIGTERM) 20:22:22.602447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23703): Terminating (SIGTERM) 20:22:22.644729 run iperf3-srv_10.42.42.10(pid=23704): Terminating (SIGTERM) 20:22:22.686794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23705): Terminating (SIGTERM) 20:22:22.728895 run iperf3-srv_10.42.42.10(pid=23706): Terminating (SIGTERM) 20:22:22.770939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23709): Terminating (SIGTERM) 20:22:22.813144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23712): Terminating (SIGTERM) 20:22:22.855345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23715): Terminating (SIGTERM) 20:22:22.897853 --- ParallelTerminationStrategy: PID 23699 died... 20:22:22.917898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23699): Terminated: ok {rc=0} 20:22:22.965448 --- ParallelTerminationStrategy: PID 23700 died... 20:22:22.985143 run iperf3-srv_10.42.42.10(pid=23700): Terminated {rc=256} 20:22:23.031997 --- ParallelTerminationStrategy: PID 23701 died... 20:22:23.051773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23701): Terminated: ok {rc=0} 20:22:23.098716 --- ParallelTerminationStrategy: PID 23702 died... 20:22:23.118669 run iperf3-srv_10.42.42.10(pid=23702): Terminated {rc=256} 20:22:23.165333 --- ParallelTerminationStrategy: PID 23703 died... 20:22:23.184841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23703): Terminated: ok {rc=0} 20:22:23.232214 --- ParallelTerminationStrategy: PID 23704 died... 20:22:23.251958 run iperf3-srv_10.42.42.10(pid=23704): Terminated {rc=256} 20:22:23.299812 --- ParallelTerminationStrategy: PID 23705 died... 20:22:23.319607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23705): Terminated: ok {rc=0} 20:22:23.366527 --- ParallelTerminationStrategy: PID 23706 died... 20:22:23.386256 run iperf3-srv_10.42.42.10(pid=23706): Terminated {rc=256} 20:22:23.433322 --- ParallelTerminationStrategy: PID 23709 died... 20:22:23.453124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23709): Terminated: ok {rc=0} 20:22:23.500640 --- ParallelTerminationStrategy: PID 23712 died... 20:22:23.520479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23712): Terminated: ok {rc=0} 20:22:23.567389 --- ParallelTerminationStrategy: PID 23715 died... 20:22:23.587139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23715): Terminated: ok {rc=0} 20:22:23.676113 bus /gobi_4: Setting Powered False 20:22:24.775709 bus /gobi_4: Setting Powered False 20:22:25.894930 bus /gobi_1: Setting Powered False 20:22:26.994112 bus /gobi_1: Setting Powered False 20:22:28.110794 bus /gobi_0: Setting Powered False 20:22:29.208464 bus /gobi_0: Setting Powered False 20:22:30.326523 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 20:22:31.448162 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:31.461656 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:22:31.523804 tst ping.py: using LAC 31275 20:22:31.651581 tst ping.py: using RAC 165 20:22:31.779101 tst ping.py: using CellId 31275 20:22:31.915677 tst ping.py: using BVCI 31276 20:22:32.057318 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:32.070562 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:32.083654 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:32.098640 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:32.112529 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:32.126527 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:32.139437 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:32.152895 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:22:32.277591 tst ping.py:19: start network... 20:22:32.493944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:32.987151 run create_hlr_db(pid=23718): Launched 20:22:33.109452 bus /gobi_6: Setting Powered False 20:22:34.172470 run create_hlr_db(pid=23718): Terminated: ok {rc=0} 20:22:34.601805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23720): Launched 20:22:34.899590 run osmo-hlr_10.42.42.2(pid=23721): Launched 20:22:35.011756 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:35.540391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23723): Launched 20:22:35.837346 run osmo-stp_10.42.42.5(pid=23724): Launched 20:22:35.949611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:36.461370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23726): Launched 20:22:36.574760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:36.825440 run patchelf(pid=23727): Launched 20:22:36.990236 run osmo-stp_10.42.42.5(pid=23724): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23724)] 20:22:37.115704 run osmo-stp_10.42.42.5(pid=23724): stdout: | (launched: 2022-12-12_20:22:35.782091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:37.242788 run osmo-stp_10.42.42.5(pid=23724): stderr: | 20221212202235949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202235949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202235949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202235950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202235950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202235950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202235950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:37.370317 run osmo-stp_10.42.42.5(pid=23724): stdout: | (launched: 2022-12-12_20:22:35.782091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:37.491695 run osmo-stp_10.42.42.5(pid=23724): stderr: | 20221212202235949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202235949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202235949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202235950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202235950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202235950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202235950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:37.635234 run patchelf(pid=23727): Terminating (SIGINT) 20:22:37.801309 run patchelf(pid=23727): Terminated: ok {rc=0} 20:22:37.920588 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23724): Process ended prematurely: osmo-stp_10.42.42.5(pid=23724) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23724)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 20:22:37.929572 tst ping.py:22: Test FAILED (6.5 sec) 20:22:37.956186 run osmo-hlr_10.42.42.2(pid=23721): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23721)] 20:22:38.003533 run osmo-hlr_10.42.42.2(pid=23721): stdout: | (launched: 2022-12-12_20:22:34.844326) 20:22:38.052427 run osmo-hlr_10.42.42.2(pid=23721): stderr: | 20221212202235018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202235018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202235018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202235018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202235018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202235019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202235029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202235038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202235038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202235039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:38.102037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23720): Terminating (SIGTERM) 20:22:38.141365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23723): Terminating (SIGTERM) 20:22:38.180868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23726): Terminating (SIGTERM) 20:22:38.220510 --- ParallelTerminationStrategy: PID 23720 died... 20:22:38.239680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23720): Terminated: ok {rc=0} 20:22:38.284053 --- ParallelTerminationStrategy: PID 23723 died... 20:22:38.302626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23723): Terminated: ok {rc=0} 20:22:38.346100 --- ParallelTerminationStrategy: PID 23726 died... 20:22:38.364647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23726): Terminated: ok {rc=0} 20:22:38.449817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 20:22:39.540097 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:39.552793 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:22:39.605281 tst ping_idle_ping.py: using LAC 31276 20:22:39.723908 tst ping_idle_ping.py: using RAC 166 20:22:39.842648 tst ping_idle_ping.py: using CellId 31276 20:22:39.960527 tst ping_idle_ping.py: using BVCI 31277 20:22:40.067909 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:40.079390 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:40.090723 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:40.102502 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:40.113855 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:40.125057 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:40.136328 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:22:40.147640 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:22:40.262704 tst ping_idle_ping.py:24: start network... 20:22:40.476350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:40.975946 run create_hlr_db(pid=23728): Launched 20:22:41.099729 bus /gobi_6: Setting Powered False 20:22:42.163144 run create_hlr_db(pid=23728): Terminated: ok {rc=0} 20:22:42.594239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23730): Launched 20:22:42.895794 run osmo-hlr_10.42.42.2(pid=23731): Launched 20:22:43.010126 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:43.534978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23733): Launched 20:22:43.835568 run osmo-stp_10.42.42.5(pid=23734): Launched 20:22:43.949529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:44.464507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23736): Launched 20:22:44.579280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:44.832745 run patchelf(pid=23737): Launched 20:22:44.999360 run osmo-stp_10.42.42.5(pid=23734): ERR: Terminated: ERROR {rc=1} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23734)] 20:22:45.125643 run osmo-stp_10.42.42.5(pid=23734): stdout: | (launched: 2022-12-12_20:22:43.779964) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:45.253771 run osmo-stp_10.42.42.5(pid=23734): stderr: | 20221212202243948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202243948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202243948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202243949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202243949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202243949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202243949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:45.382183 run osmo-stp_10.42.42.5(pid=23734): stdout: | (launched: 2022-12-12_20:22:43.779964) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:45.504404 run osmo-stp_10.42.42.5(pid=23734): stderr: | 20221212202243948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202243948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202243948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202243949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202243949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202243949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202243949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:45.649259 run patchelf(pid=23737): Terminating (SIGINT) 20:22:45.816624 run patchelf(pid=23737): Terminated: ok {rc=0} 20:22:45.979813 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23734): Process ended prematurely: osmo-stp_10.42.42.5(pid=23734) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23734)] [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 20:22:45.990959 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:22:46.029252 run osmo-hlr_10.42.42.2(pid=23731): ERR: Terminated: ERROR {rc=237} [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23731)] 20:22:46.078794 run osmo-hlr_10.42.42.2(pid=23731): stdout: | (launched: 2022-12-12_20:22:42.840124) 20:22:46.130214 run osmo-hlr_10.42.42.2(pid=23731): stderr: | 20221212202243014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202243014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202243014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202243014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202243014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202243014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202243027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202243035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202243036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202243036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:46.181890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23730): Terminating (SIGTERM) 20:22:46.223440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23733): Terminating (SIGTERM) 20:22:46.265850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23736): Terminating (SIGTERM) 20:22:46.309204 --- ParallelTerminationStrategy: PID 23730 died... 20:22:46.329518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23730): Terminated: ok {rc=0} 20:22:46.376800 --- ParallelTerminationStrategy: PID 23733 died... 20:22:46.396892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23733): Terminated: ok {rc=0} 20:22:46.444382 --- ParallelTerminationStrategy: PID 23736 died... 20:22:46.463978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23736): Terminated: ok {rc=0} 20:22:46.551752 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 20:22:47.867133 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:47.875995 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:22:47.910609 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:22:47.946227 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:22:48.001732 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:22:48.035528 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:22:48.071462 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:22:48.631530 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2381 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:22:48.637389 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:48.649798 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:22:48.719645 tst switch_tch_pdch.py: using LAC 31277 20:22:48.844175 tst switch_tch_pdch.py: using RAC 167 20:22:48.967986 tst switch_tch_pdch.py: using CellId 31277 20:22:49.092532 tst switch_tch_pdch.py: using BVCI 31278 20:22:49.208111 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:49.220147 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:49.232006 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:49.244376 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:49.256942 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:49.269454 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:49.282004 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:49.294980 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:22:49.411827 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:22:49.526798 tst switch_tch_pdch.py:51: start network... 20:22:49.725438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:50.185124 run create_hlr_db(pid=23741): Launched 20:22:50.311810 bus /gobi_6: Setting Powered False 20:22:51.374574 run create_hlr_db(pid=23741): Terminated: ok {rc=0} 20:22:51.818295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23743): Launched 20:22:52.138673 run osmo-hlr_10.42.42.2(pid=23744): Launched 20:22:52.260793 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:52.810592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23746): Launched 20:22:53.131061 run osmo-stp_10.42.42.5(pid=23747): Launched 20:22:53.253149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:53.807117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23749): Launched 20:22:53.931355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:54.202768 run patchelf(pid=23750): Launched 20:22:54.383277 run osmo-stp_10.42.42.5(pid=23747): ERR: Terminated: ERROR {rc=1} [trial-2381↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23747)] 20:22:54.519010 run osmo-stp_10.42.42.5(pid=23747): stdout: | (launched: 2022-12-12_20:22:53.071560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:54.656861 run osmo-stp_10.42.42.5(pid=23747): stderr: | 20221212202253260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202253260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202253260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202253261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202253261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202253261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202253261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:54.794281 run osmo-stp_10.42.42.5(pid=23747): stdout: | (launched: 2022-12-12_20:22:53.071560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:54.925653 run osmo-stp_10.42.42.5(pid=23747): stderr: | 20221212202253260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202253260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202253260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202253261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202253261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202253261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202253261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:55.081771 run patchelf(pid=23750): Terminating (SIGINT) 20:22:55.259984 run patchelf(pid=23750): Terminated: ok {rc=0} 20:22:55.389189 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23747): Process ended prematurely: osmo-stp_10.42.42.5(pid=23747) [trial-2381↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23747)] [trial-2381↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:22:55.398892 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 20:22:55.427879 run osmo-hlr_10.42.42.2(pid=23744): ERR: Terminated: ERROR {rc=237} [trial-2381↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23744)] 20:22:55.478600 run osmo-hlr_10.42.42.2(pid=23744): stdout: | (launched: 2022-12-12_20:22:52.080128) 20:22:55.532018 run osmo-hlr_10.42.42.2(pid=23744): stderr: | 20221212202252273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202252273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202252273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202252273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202252273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202252273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202252286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202252295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202252295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202252295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:55.585437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23743): Terminating (SIGTERM) 20:22:55.628017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23746): Terminating (SIGTERM) 20:22:55.670706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23749): Terminating (SIGTERM) 20:22:55.713415 --- ParallelTerminationStrategy: PID 23743 died... 20:22:55.733507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23743): Terminated: ok {rc=0} 20:22:55.781093 --- ParallelTerminationStrategy: PID 23746 died... 20:22:55.800889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23746): Terminated: ok {rc=0} 20:22:55.847890 --- ParallelTerminationStrategy: PID 23749 died... 20:22:55.867632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23749): Terminated: ok {rc=0} 20:22:55.957495 bus /gobi_0: Setting Powered False 20:22:57.056940 bus /gobi_0: Setting Powered False 20:22:58.174023 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2381 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 nitb_smpp --------------------------------------------------------------------- 20:22:59.425227 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:59.427576 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 20:22:59.447993 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 20:22:59.454673 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 20:22:59.489456 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 20:22:59.510772 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 20:22:59.518728 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 20:23:00.036516 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2381 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 20:23:00.042449 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 20:23:00.062097 tst esme_connect_policy_acceptall.py: using MSISDN 7948 20:23:00.195720 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:23:00.764263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23755): Launched 20:23:01.090159 run osmo-nitb_10.42.42.2(pid=23756): Launched 20:23:01.281205 run osmo-nitb_10.42.42.2(pid=23756): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23756)] 20:23:01.420366 run osmo-nitb_10.42.42.2(pid=23756): stdout: | (launched: 2022-12-12_20:23:01.032677) 20:23:01.559852 run osmo-nitb_10.42.42.2(pid=23756): stderr: | (launched: 2022-12-12_20:23:01.078551) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:01.699899 run osmo-nitb_10.42.42.2(pid=23756): stdout: | (launched: 2022-12-12_20:23:01.032677) 20:23:01.834085 run osmo-nitb_10.42.42.2(pid=23756): stderr: | (launched: 2022-12-12_20:23:01.078551) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23756) [trial-2381↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23756)] 20:23:02.226574 tst osmo-nitb_10.42.42.2(pid=23756): stdout: | (launched: 2022-12-12_20:23:01.032677) 20:23:02.350278 tst osmo-nitb_10.42.42.2(pid=23756): stderr: | (launched: 2022-12-12_20:23:01.078551) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:02.494871 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=23756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23756) [trial-2381↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23756)] [trial-2381↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 20:23:02.503189 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 20:23:02.509850 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23755): Terminating (SIGTERM) 20:23:02.718598 --- ParallelTerminationStrategy: PID 23755 died... 20:23:02.739426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23755): Terminated: ok {rc=0} ---------------------------------------------- trial-2381 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 20:23:02.788043 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 20:23:02.809065 tst esme_connect_policy_closed.py: using MSISDN 7949 20:23:02.929473 tst esme_connect_policy_closed.py: using MSISDN 7950 20:23:03.039261 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:23:03.606420 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23757): Launched 20:23:03.913325 run osmo-nitb_10.42.42.2(pid=23758): Launched 20:23:04.077195 run osmo-nitb_10.42.42.2(pid=23758): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23758)] 20:23:04.202501 run osmo-nitb_10.42.42.2(pid=23758): stdout: | (launched: 2022-12-12_20:23:03.857049) 20:23:04.328854 run osmo-nitb_10.42.42.2(pid=23758): stderr: | (launched: 2022-12-12_20:23:03.902179) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:04.455137 run osmo-nitb_10.42.42.2(pid=23758): stdout: | (launched: 2022-12-12_20:23:03.857049) 20:23:04.575662 run osmo-nitb_10.42.42.2(pid=23758): stderr: | (launched: 2022-12-12_20:23:03.902179) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:04.721059 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=23758): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23758) [trial-2381↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23758)] [trial-2381↪nitb_smpp↪esme_connect_policy_closed.py:24] 20:23:04.729489 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 20:23:04.735903 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23757): Terminating (SIGTERM) 20:23:04.945127 --- ParallelTerminationStrategy: PID 23757 died... 20:23:04.965253 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23757): Terminated: ok {rc=0} ---------------------------------------------- trial-2381 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 20:23:05.013630 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 20:23:05.024637 tst nitb_smpp: Using 1 x bts (candidates: 1) 20:23:05.060604 tst esme_ms_sms_storeforward.py: using LAC 31278 20:23:05.181117 tst esme_ms_sms_storeforward.py: using RAC 168 20:23:05.302908 tst esme_ms_sms_storeforward.py: using CellId 31278 20:23:05.433942 tst esme_ms_sms_storeforward.py: using BVCI 31279 20:23:05.544886 tst nitb_smpp: Using 1 x modem (candidates: 1) 20:23:05.673651 tst esme_ms_sms_storeforward.py: using MSISDN 7951 20:23:05.792145 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 20:23:06.013488 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:23:06.682666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23759): Launched 20:23:07.012227 run osmo-nitb_10.42.42.2(pid=23760): Launched 20:23:07.189955 run osmo-nitb_10.42.42.2(pid=23760): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23760)] 20:23:07.325903 run osmo-nitb_10.42.42.2(pid=23760): stdout: | (launched: 2022-12-12_20:23:06.951946) 20:23:07.462302 run osmo-nitb_10.42.42.2(pid=23760): stderr: | (launched: 2022-12-12_20:23:07.000932) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:07.599177 run osmo-nitb_10.42.42.2(pid=23760): stdout: | (launched: 2022-12-12_20:23:06.951946) 20:23:07.729667 run osmo-nitb_10.42.42.2(pid=23760): stderr: | (launched: 2022-12-12_20:23:07.000932) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:07.886144 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=23760): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23760) [trial-2381↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23760)] [trial-2381↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 20:23:07.895154 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 20:23:07.902283 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23759): Terminating (SIGTERM) 20:23:08.113554 --- ParallelTerminationStrategy: PID 23759 died... 20:23:08.136214 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23759): Terminated: ok {rc=0} 20:23:08.225441 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 20:23:09.313632 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 20:23:09.325843 tst nitb_smpp: Using 1 x bts (candidates: 1) 20:23:09.365336 tst esme_ms_sms_transaction.py: using LAC 31279 20:23:09.494287 tst esme_ms_sms_transaction.py: using RAC 169 20:23:09.622291 tst esme_ms_sms_transaction.py: using CellId 31279 20:23:09.751988 tst esme_ms_sms_transaction.py: using BVCI 31280 20:23:09.872563 tst nitb_smpp: Using 1 x modem (candidates: 1) 20:23:10.002519 tst esme_ms_sms_transaction.py: using MSISDN 7952 20:23:10.113475 tst esme_ms_sms_transaction.py:18: start nitb and bts... 20:23:10.317953 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:23:10.938909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23761): Launched 20:23:11.245670 run osmo-nitb_10.42.42.2(pid=23762): Launched 20:23:11.414846 run osmo-nitb_10.42.42.2(pid=23762): ERR: Terminated: ERROR {rc=2} [trial-2381↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23762)] 20:23:11.551439 run osmo-nitb_10.42.42.2(pid=23762): stdout: | (launched: 2022-12-12_20:23:11.189492) 20:23:11.690016 run osmo-nitb_10.42.42.2(pid=23762): stderr: | (launched: 2022-12-12_20:23:11.234554) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:11.827539 run osmo-nitb_10.42.42.2(pid=23762): stdout: | (launched: 2022-12-12_20:23:11.189492) 20:23:11.959766 run osmo-nitb_10.42.42.2(pid=23762): stderr: | (launched: 2022-12-12_20:23:11.234554) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23762): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23762) [trial-2381↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23762)] 20:23:12.360489 tst osmo-nitb_10.42.42.2(pid=23762): stdout: | (launched: 2022-12-12_20:23:11.189492) 20:23:12.483333 tst osmo-nitb_10.42.42.2(pid=23762): stderr: | (launched: 2022-12-12_20:23:11.234554) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:12.627736 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=23762): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23762) [trial-2381↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23762)] [trial-2381↪nitb_smpp↪esme_ms_sms_transaction.py:21] 20:23:12.636180 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 20:23:12.642688 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23761): Terminating (SIGTERM) 20:23:12.851859 --- ParallelTerminationStrategy: PID 23761 died... 20:23:12.872560 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23761): Terminated: ok {rc=0} 20:23:12.959704 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 smpp --------------------------------------------------------------------- 20:23:14.136368 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:14.139980 tst smpp: Verifying 1 x bts (candidates: 11) 20:23:14.161131 tst smpp: Verifying 6 x ip_address (candidates: 9) 20:23:14.188185 tst smpp: Verifying 1 x modem (candidates: 12) 20:23:14.222484 tst smpp: Reserving 1 x bts (candidates: 11) 20:23:14.242863 tst smpp: Reserving 6 x ip_address (candidates: 9) 20:23:14.268994 tst smpp: Reserving 1 x modem (candidates: 12) 20:23:14.797980 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 20:23:14.805588 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:14.817257 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:14.828698 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:14.839615 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:14.858174 tst esme_connect_policy_acceptall.py: using MSISDN 7953 20:23:14.979201 run osmo-stp_10.42.42.4: Starting osmo-stp 20:23:15.538469 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23767): Launched 20:23:15.881747 run osmo-stp_10.42.42.4(pid=23768): Launched 20:23:16.088901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:16.607532 run create_hlr_db(pid=23769): Launched 20:23:16.748217 bus /sierra_2: Setting Powered False 20:23:17.809714 run create_hlr_db(pid=23769): Terminated: ok {rc=0} 20:23:18.255867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23771): Launched 20:23:18.586102 run osmo-hlr_10.42.42.2(pid=23772): Launched 20:23:18.712082 run osmo-msc_10.42.42.5: Starting osmo-msc 20:23:19.307325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23774): Launched 20:23:19.637266 run osmo-msc_10.42.42.5(pid=23775): Launched 20:23:19.821228 run osmo-hlr_10.42.42.2(pid=23772): ERR: Terminated: ERROR {rc=237} [trial-2381↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23772)] 20:23:19.979046 run osmo-hlr_10.42.42.2(pid=23772): stdout: | (launched: 2022-12-12_20:23:18.525759) 20:23:20.118490 run osmo-hlr_10.42.42.2(pid=23772): stderr: | 20221212202318718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202318718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202318718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202318718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202318719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202318719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202318731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202318741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202318742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202318742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:20.256555 run osmo-hlr_10.42.42.2(pid=23772): stdout: | (launched: 2022-12-12_20:23:18.525759) 20:23:20.387534 run osmo-hlr_10.42.42.2(pid=23772): stderr: | 20221212202318718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202318718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202318718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202318718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202318719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202318719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202318731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202318741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202318742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202318742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:20.544088 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=23772): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23772) [trial-2381↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23772)] [trial-2381↪smpp↪esme_connect_policy_acceptall.py:23] 20:23:20.552934 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.7 sec) 20:23:20.581376 run osmo-msc_10.42.42.5(pid=23775): ERR: Terminated: ERROR {rc=9} [trial-2381↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=23775)] 20:23:20.632088 run osmo-msc_10.42.42.5(pid=23775): stdout: | (launched: 2022-12-12_20:23:19.576700) 20:23:20.684491 run osmo-msc_10.42.42.5(pid=23775): stderr: | 20221212202319948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221212202319948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221212202319948 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202319948 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221212202319948 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221212202319949 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221212202319949 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221212202319949 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212202319949 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 20:23:20.737331 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23767): Terminating (SIGTERM) 20:23:20.780127 run osmo-stp_10.42.42.4(pid=23768): Terminating (SIGTERM) 20:23:20.822610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23771): Terminating (SIGTERM) 20:23:20.866792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23774): Terminating (SIGTERM) 20:23:20.912339 --- ParallelTerminationStrategy: PID 23767 died... 20:23:20.933248 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23767): Terminated: ok {rc=0} 20:23:20.982778 --- ParallelTerminationStrategy: PID 23768 died... 20:23:21.002526 run osmo-stp_10.42.42.4(pid=23768): Terminated: ok {rc=0} 20:23:21.049838 --- ParallelTerminationStrategy: PID 23771 died... 20:23:21.069847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23771): Terminated: ok {rc=0} 20:23:21.117544 --- ParallelTerminationStrategy: PID 23774 died... 20:23:21.137406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23774): Terminated: ok {rc=0} ---------------------------------------------- trial-2381 smpp esme_connect_policy_closed.py ---------------------------------------------- 20:23:21.189722 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:21.201427 tst smpp: Using 1 x bts (candidates: 1) 20:23:21.239064 tst esme_connect_policy_closed.py: using LAC 31280 20:23:21.369688 tst esme_connect_policy_closed.py: using RAC 170 20:23:21.496664 tst esme_connect_policy_closed.py: using CellId 31280 20:23:21.625921 tst esme_connect_policy_closed.py: using BVCI 31281 20:23:21.744322 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:21.755208 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:21.766058 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:21.786502 tst esme_connect_policy_closed.py: using MSISDN 7954 20:23:21.915975 tst esme_connect_policy_closed.py: using MSISDN 7955 20:23:22.034046 run osmo-stp_10.42.42.4: Starting osmo-stp 20:23:22.592059 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23778): Launched 20:23:22.921503 run osmo-stp_10.42.42.4(pid=23779): Launched 20:23:23.048519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:23.558246 run create_hlr_db(pid=23780): Launched 20:23:24.742154 run create_hlr_db(pid=23780): Terminated: ok {rc=0} 20:23:25.088123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Launched 20:23:25.419428 run osmo-hlr_10.42.42.2(pid=23783): Launched 20:23:25.545489 run osmo-msc_10.42.42.5: Starting osmo-msc 20:23:26.144500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Launched 20:23:26.474716 run osmo-msc_10.42.42.5(pid=23786): Launched 20:23:26.659640 run osmo-hlr_10.42.42.2(pid=23783): ERR: Terminated: ERROR {rc=237} [trial-2381↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23783)] 20:23:26.798853 run osmo-hlr_10.42.42.2(pid=23783): stdout: | (launched: 2022-12-12_20:23:25.358550) 20:23:26.938878 run osmo-hlr_10.42.42.2(pid=23783): stderr: | 20221212202325553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202325553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202325565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202325574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202325574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202325574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:27.075315 run osmo-hlr_10.42.42.2(pid=23783): stdout: | (launched: 2022-12-12_20:23:25.358550) 20:23:27.206020 run osmo-hlr_10.42.42.2(pid=23783): stderr: | 20221212202325553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202325553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202325553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202325565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202325574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202325574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202325574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:27.363183 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=23783): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23783) [trial-2381↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23783)] [trial-2381↪smpp↪esme_connect_policy_closed.py:31] 20:23:27.372016 tst esme_connect_policy_closed.py:31: Test FAILED (6.2 sec) 20:23:27.399964 run osmo-msc_10.42.42.5(pid=23786): ERR: Terminated: ERROR {rc=9} [trial-2381↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=23786)] 20:23:27.451336 run osmo-msc_10.42.42.5(pid=23786): stdout: | (launched: 2022-12-12_20:23:26.413968) 20:23:27.504285 run osmo-msc_10.42.42.5(pid=23786): stderr: | 20221212202326784 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221212202326784 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221212202326784 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202326784 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221212202326784 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221212202326784 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221212202326785 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221212202326785 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212202326785 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 20:23:27.557609 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23778): Terminating (SIGTERM) 20:23:27.600331 run osmo-stp_10.42.42.4(pid=23779): Terminating (SIGTERM) 20:23:27.643283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Terminating (SIGTERM) 20:23:27.687703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Terminating (SIGTERM) 20:23:27.732582 --- ParallelTerminationStrategy: PID 23778 died... 20:23:27.753701 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23778): Terminated: ok {rc=0} 20:23:27.803234 --- ParallelTerminationStrategy: PID 23779 died... 20:23:27.823146 run osmo-stp_10.42.42.4(pid=23779): Terminated: ok {rc=0} 20:23:27.870845 --- ParallelTerminationStrategy: PID 23782 died... 20:23:27.890675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Terminated: ok {rc=0} 20:23:27.938370 --- ParallelTerminationStrategy: PID 23785 died... 20:23:27.958339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Terminated: ok {rc=0} ---------------------------------------------- trial-2381 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 20:23:28.010840 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:28.022596 tst smpp: Using 1 x bts (candidates: 1) 20:23:28.059853 tst esme_ms_sms_storeforward.py: using LAC 31281 20:23:28.183319 tst esme_ms_sms_storeforward.py: using RAC 171 20:23:28.306875 tst esme_ms_sms_storeforward.py: using CellId 31281 20:23:28.429117 tst esme_ms_sms_storeforward.py: using BVCI 31282 20:23:28.540828 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:28.551506 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:28.562087 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:28.574287 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:28.586063 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:28.597195 tst smpp: Using 1 x modem (candidates: 1) 20:23:28.727360 tst esme_ms_sms_storeforward.py: using MSISDN 7956 20:23:28.841672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:29.317146 run create_hlr_db(pid=23789): Launched 20:23:30.496751 run create_hlr_db(pid=23789): Terminated: ok {rc=0} 20:23:30.820825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23791): Launched 20:23:31.179298 run osmo-hlr_10.42.42.2(pid=23792): Launched 20:23:31.455095 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:32.100568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23794): Launched 20:23:32.424890 run osmo-stp_10.42.42.5(pid=23795): Launched 20:23:32.541969 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:33.099266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23797): Launched 20:23:33.406591 run osmo-msc_10.42.42.6(pid=23798): Launched 20:23:33.578243 run osmo-stp_10.42.42.5(pid=23795): ERR: Terminated: ERROR {rc=1} [trial-2381↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23795)] 20:23:33.708485 run osmo-stp_10.42.42.5(pid=23795): stdout: | (launched: 2022-12-12_20:23:32.367716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:33.837658 run osmo-stp_10.42.42.5(pid=23795): stderr: | 20221212202332540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202332540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202332541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202332541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202332542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202332542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202332542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:33.965624 run osmo-stp_10.42.42.5(pid=23795): stdout: | (launched: 2022-12-12_20:23:32.367716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:34.087665 run osmo-stp_10.42.42.5(pid=23795): stderr: | 20221212202332540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202332540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202332541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202332541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202332542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202332542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202332542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:34.233767 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=23795): Process ended prematurely: osmo-stp_10.42.42.5(pid=23795) [trial-2381↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23795)] [trial-2381↪smpp↪esme_ms_sms_storeforward.py:30] 20:23:34.242079 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 20:23:34.268209 run osmo-hlr_10.42.42.2(pid=23792): ERR: Terminated: ERROR {rc=237} [trial-2381↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23792)] 20:23:34.316236 run osmo-hlr_10.42.42.2(pid=23792): stdout: | (launched: 2022-12-12_20:23:31.120245) 20:23:34.366149 run osmo-hlr_10.42.42.2(pid=23792): stderr: | 20221212202331366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202331366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202331366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202331366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202331366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202331366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202331383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202331399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202331399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202331400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:34.435759 run osmo-msc_10.42.42.6(pid=23798): ERR: Terminated: ERROR {rc=2} [trial-2381↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23798)] 20:23:34.483883 run osmo-msc_10.42.42.6(pid=23798): stdout: | (launched: 2022-12-12_20:23:33.349156) 20:23:34.533476 run osmo-msc_10.42.42.6(pid=23798): stderr: | 20221212202333620 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202333621 DLGLOBAL DEBUG validating counter group 0x7feb7dd97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202333621 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202333621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202333621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202333621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202333623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202333623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202333624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202333624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:34.583642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23791): Terminating (SIGTERM) 20:23:34.623465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23794): Terminating (SIGTERM) 20:23:34.663474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23797): Terminating (SIGTERM) 20:23:34.703590 --- ParallelTerminationStrategy: PID 23791 died... 20:23:34.722785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23791): Terminated: ok {rc=0} 20:23:34.767417 --- ParallelTerminationStrategy: PID 23794 died... 20:23:34.786072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23794): Terminated: ok {rc=0} 20:23:34.830019 --- ParallelTerminationStrategy: PID 23797 died... 20:23:34.848678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23797): Terminated: ok {rc=0} 20:23:34.935833 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 smpp esme_ms_sms_transaction.py ---------------------------------------------- 20:23:36.023679 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:36.034942 tst smpp: Using 1 x bts (candidates: 1) 20:23:36.073954 tst esme_ms_sms_transaction.py: using LAC 31282 20:23:36.194729 tst esme_ms_sms_transaction.py: using RAC 172 20:23:36.316846 tst esme_ms_sms_transaction.py: using CellId 31282 20:23:36.436431 tst esme_ms_sms_transaction.py: using BVCI 31283 20:23:36.546556 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:36.556901 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:36.567250 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:36.577697 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:36.587923 tst smpp: Using 1 x ip_address (candidates: 6) 20:23:36.598216 tst smpp: Using 1 x modem (candidates: 1) 20:23:36.726972 tst esme_ms_sms_transaction.py: using MSISDN 7957 20:23:36.846148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:37.356153 run create_hlr_db(pid=23800): Launched 20:23:37.482152 bus /sierra_2: Setting Powered False 20:23:38.546687 run create_hlr_db(pid=23800): Terminated: ok {rc=0} 20:23:38.987497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23802): Launched 20:23:39.319380 run osmo-hlr_10.42.42.2(pid=23803): Launched 20:23:39.448134 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:40.012804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23805): Launched 20:23:40.343697 run osmo-stp_10.42.42.5(pid=23806): Launched 20:23:40.471799 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:41.066202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23808): Launched 20:23:41.396518 run osmo-msc_10.42.42.6(pid=23809): Launched 20:23:41.581420 run osmo-stp_10.42.42.5(pid=23806): ERR: Terminated: ERROR {rc=1} [trial-2381↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23806)] 20:23:41.720258 run osmo-stp_10.42.42.5(pid=23806): stdout: | (launched: 2022-12-12_20:23:40.282557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:41.859648 run osmo-stp_10.42.42.5(pid=23806): stderr: | 20221212202340474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202340474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202340474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202340475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202340475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202340475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202340475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:41.996903 run osmo-stp_10.42.42.5(pid=23806): stdout: | (launched: 2022-12-12_20:23:40.282557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:42.128105 run osmo-stp_10.42.42.5(pid=23806): stderr: | 20221212202340474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202340474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202340474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202340475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202340475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202340475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202340475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:42.285392 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=23806): Process ended prematurely: osmo-stp_10.42.42.5(pid=23806) [trial-2381↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23806)] [trial-2381↪smpp↪esme_ms_sms_transaction.py:28] 20:23:42.294415 tst esme_ms_sms_transaction.py:28: Test FAILED (6.3 sec) 20:23:42.322998 run osmo-hlr_10.42.42.2(pid=23803): ERR: Terminated: ERROR {rc=237} [trial-2381↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23803)] 20:23:42.374712 run osmo-hlr_10.42.42.2(pid=23803): stdout: | (launched: 2022-12-12_20:23:39.258976) 20:23:42.428093 run osmo-hlr_10.42.42.2(pid=23803): stderr: | 20221212202339459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202339459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202339459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202339459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202339459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202339459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202339471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202339479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202339480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202339480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:42.501754 run osmo-msc_10.42.42.6(pid=23809): ERR: Terminated: ERROR {rc=2} [trial-2381↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23809)] 20:23:42.552879 run osmo-msc_10.42.42.6(pid=23809): stdout: | (launched: 2022-12-12_20:23:41.335222) 20:23:42.605907 run osmo-msc_10.42.42.6(pid=23809): stderr: | 20221212202341657 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202341657 DLGLOBAL DEBUG validating counter group 0x7f741fa9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202341657 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202341657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202341657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202341657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202341659 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202341660 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202341660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202341660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:42.659073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23802): Terminating (SIGTERM) 20:23:42.701399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23805): Terminating (SIGTERM) 20:23:42.743968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23808): Terminating (SIGTERM) 20:23:42.786843 --- ParallelTerminationStrategy: PID 23802 died... 20:23:42.807221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23802): Terminated: ok {rc=0} 20:23:42.854822 --- ParallelTerminationStrategy: PID 23805 died... 20:23:42.874576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23805): Terminated: ok {rc=0} 20:23:42.921871 --- ParallelTerminationStrategy: PID 23808 died... 20:23:42.941635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23808): Terminated: ok {rc=0} 20:23:43.031788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 encryption --------------------------------------------------------------------- 20:23:44.229402 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:44.232845 tst encryption: Verifying 1 x bts (candidates: 11) 20:23:44.254761 tst encryption: Verifying 6 x ip_address (candidates: 9) 20:23:44.283701 tst encryption: Verifying 1 x modem (candidates: 12) 20:23:44.320619 tst encryption: Reserving 1 x bts (candidates: 11) 20:23:44.342549 tst encryption: Reserving 6 x ip_address (candidates: 9) 20:23:44.370275 tst encryption: Reserving 1 x modem (candidates: 12) 20:23:44.898183 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2381 encryption register_a5_0_authopt.py ---------------------------------------------- 20:23:44.954619 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:44.965723 tst encryption: Using 1 x bts (candidates: 1) 20:23:45.002851 tst register_a5_0_authopt.py: using LAC 31283 20:23:45.134804 tst register_a5_0_authopt.py: using RAC 173 20:23:45.258519 tst register_a5_0_authopt.py: using CellId 31283 20:23:45.381035 tst register_a5_0_authopt.py: using BVCI 31284 20:23:45.493109 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:45.503623 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:45.514263 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:45.525084 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:45.535729 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:45.546154 tst encryption: Using 1 x modem (candidates: 1) 20:23:45.663659 tst register_a5_0_authopt.py:8: start network... 20:23:45.908223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:46.465279 run create_hlr_db(pid=23835): Launched 20:23:46.649753 bus /sierra_2: Setting Powered False 20:23:47.743124 run create_hlr_db(pid=23835): Terminated: ok {rc=0} 20:23:48.334662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23979): Launched 20:23:48.748276 run osmo-hlr_10.42.42.2(pid=24030): Launched 20:23:48.990676 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:49.760404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24088): Launched 20:23:50.113178 run osmo-stp_10.42.42.5(pid=24089): Launched 20:23:50.368507 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:51.045700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24091): Launched 20:23:51.395033 run osmo-msc_10.42.42.6(pid=24093): Launched 20:23:51.702625 run osmo-stp_10.42.42.5(pid=24089): ERR: Terminated: ERROR {rc=1} [trial-2381↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24089)] 20:23:51.995823 run osmo-stp_10.42.42.5(pid=24089): stdout: | (launched: 2022-12-12_20:23:50.047908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:52.207749 run osmo-stp_10.42.42.5(pid=24089): stderr: | 20221212202350347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202350347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202350347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202350348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202350348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202350348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202350348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:52.349302 run osmo-stp_10.42.42.5(pid=24089): stdout: | (launched: 2022-12-12_20:23:50.047908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:52.484405 run osmo-stp_10.42.42.5(pid=24089): stderr: | 20221212202350347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202350347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202350347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202350348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202350348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202350348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202350348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:52.647187 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24089): Process ended prematurely: osmo-stp_10.42.42.5(pid=24089) [trial-2381↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24089)] [trial-2381↪encryption↪register_a5_0_authopt.py:8] 20:23:52.657852 tst register_a5_0_authopt.py:8: Test FAILED (7.7 sec) 20:23:52.689375 run osmo-hlr_10.42.42.2(pid=24030): ERR: Terminated: ERROR {rc=237} [trial-2381↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24030)] 20:23:52.742398 run osmo-hlr_10.42.42.2(pid=24030): stdout: | (launched: 2022-12-12_20:23:48.676692) 20:23:52.797489 run osmo-hlr_10.42.42.2(pid=24030): stderr: | 20221212202349034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202349034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202349034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202349034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202349034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202349034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202349051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202349068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202349068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202349068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:52.873356 run osmo-msc_10.42.42.6(pid=24093): ERR: Terminated: ERROR {rc=2} [trial-2381↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24093)] 20:23:52.926780 run osmo-msc_10.42.42.6(pid=24093): stdout: | (launched: 2022-12-12_20:23:51.333120) 20:23:52.981614 run osmo-msc_10.42.42.6(pid=24093): stderr: | 20221212202351861 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202351862 DLGLOBAL DEBUG validating counter group 0x7f49da441c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202351862 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202351862 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202351862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202351862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202351864 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202351864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202351865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202351865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:53.037567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23979): Terminating (SIGTERM) 20:23:53.082457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24088): Terminating (SIGTERM) 20:23:53.129099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24091): Terminating (SIGTERM) 20:23:53.175841 --- ParallelTerminationStrategy: PID 23979 died... 20:23:53.196913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23979): Terminated: ok {rc=0} 20:23:53.248195 --- ParallelTerminationStrategy: PID 24088 died... 20:23:53.269001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24088): Terminated: ok {rc=0} 20:23:53.319454 --- ParallelTerminationStrategy: PID 24091 died... 20:23:53.340173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24091): Terminated: ok {rc=0} 20:23:53.433501 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 encryption register_a5_0_authreq.py ---------------------------------------------- 20:23:54.595515 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:54.608593 tst encryption: Using 1 x bts (candidates: 1) 20:23:54.648045 tst register_a5_0_authreq.py: using LAC 31284 20:23:54.781221 tst register_a5_0_authreq.py: using RAC 174 20:23:54.914183 tst register_a5_0_authreq.py: using CellId 31284 20:23:55.050743 tst register_a5_0_authreq.py: using BVCI 31285 20:23:55.176936 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:55.190068 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:55.202121 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:55.216713 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:55.228629 tst encryption: Using 1 x ip_address (candidates: 6) 20:23:55.241585 tst encryption: Using 1 x modem (candidates: 1) 20:23:55.371785 tst register_a5_0_authreq.py:8: start network... 20:23:55.605859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:56.135023 run create_hlr_db(pid=24096): Launched 20:23:56.304608 bus /sierra_2: Setting Powered False 20:23:57.375338 run create_hlr_db(pid=24096): Terminated: ok {rc=0} 20:23:57.852297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24098): Launched 20:23:58.207265 run osmo-hlr_10.42.42.2(pid=24099): Launched 20:23:58.466509 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:59.154202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24101): Launched 20:23:59.512221 run osmo-stp_10.42.42.5(pid=24102): Launched 20:23:59.773710 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:00.470672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24104): Launched 20:24:00.826695 run osmo-msc_10.42.42.6(pid=24105): Launched 20:24:01.149529 run osmo-stp_10.42.42.5(pid=24102): ERR: Terminated: ERROR {rc=1} [trial-2381↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24102)] 20:24:01.454548 run osmo-stp_10.42.42.5(pid=24102): stdout: | (launched: 2022-12-12_20:23:59.450169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:01.723471 run osmo-stp_10.42.42.5(pid=24102): stderr: | 20221212202359745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202359745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202359745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202359745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202359746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202359746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202359746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:01.952675 run osmo-stp_10.42.42.5(pid=24102): stdout: | (launched: 2022-12-12_20:23:59.450169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:02.119085 run osmo-stp_10.42.42.5(pid=24102): stderr: | 20221212202359745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202359745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202359745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202359745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202359746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202359746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202359746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:02.313397 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24102): Process ended prematurely: osmo-stp_10.42.42.5(pid=24102) [trial-2381↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24102)] [trial-2381↪encryption↪register_a5_0_authreq.py:8] 20:24:02.325623 tst register_a5_0_authreq.py:8: Test FAILED (7.8 sec) 20:24:02.365976 run osmo-hlr_10.42.42.2(pid=24099): ERR: Terminated: ERROR {rc=237} [trial-2381↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24099)] 20:24:02.428670 run osmo-hlr_10.42.42.2(pid=24099): stdout: | (launched: 2022-12-12_20:23:58.143886) 20:24:02.492245 run osmo-hlr_10.42.42.2(pid=24099): stderr: | 20221212202358459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202358459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202358459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202358459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202358459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202358460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202358479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202358488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202358488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202358488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:02.582415 run osmo-msc_10.42.42.6(pid=24105): ERR: Terminated: ERROR {rc=2} [trial-2381↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24105)] 20:24:02.643012 run osmo-msc_10.42.42.6(pid=24105): stdout: | (launched: 2022-12-12_20:24:00.764755) 20:24:02.708744 run osmo-msc_10.42.42.6(pid=24105): stderr: | 20221212202401291 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202401291 DLGLOBAL DEBUG validating counter group 0x7f0ebb0d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202401291 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202401291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202401291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202401291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202401296 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202401305 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202401305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202401305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:02.775673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24098): Terminating (SIGTERM) 20:24:02.829085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24101): Terminating (SIGTERM) 20:24:02.883934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24104): Terminating (SIGTERM) 20:24:02.934544 --- ParallelTerminationStrategy: PID 24098 died... 20:24:02.958921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24098): Terminated: ok {rc=0} 20:24:03.020313 --- ParallelTerminationStrategy: PID 24101 died... 20:24:03.045343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24101): Terminated: ok {rc=0} 20:24:03.103960 --- ParallelTerminationStrategy: PID 24104 died... 20:24:03.128027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24104): Terminated: ok {rc=0} 20:24:03.246136 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 encryption register_a5_1_authreq.py ---------------------------------------------- 20:24:04.434137 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:04.446567 tst encryption: Using 1 x bts (candidates: 1) 20:24:04.495435 tst register_a5_1_authreq.py: using LAC 31285 20:24:04.627404 tst register_a5_1_authreq.py: using RAC 175 20:24:04.754824 tst register_a5_1_authreq.py: using CellId 31285 20:24:04.880842 tst register_a5_1_authreq.py: using BVCI 31286 20:24:04.999357 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:05.011165 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:05.023272 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:05.034862 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:05.046625 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:05.058624 tst encryption: Using 1 x modem (candidates: 1) 20:24:05.178660 tst register_a5_1_authreq.py:8: start network... 20:24:05.397161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:05.894524 run create_hlr_db(pid=24107): Launched 20:24:06.061259 bus /sierra_2: Setting Powered False 20:24:07.124769 run create_hlr_db(pid=24107): Terminated: ok {rc=0} 20:24:07.580227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24109): Launched 20:24:07.916633 run osmo-hlr_10.42.42.2(pid=24110): Launched 20:24:08.165574 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:08.891259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24112): Launched 20:24:09.229241 run osmo-stp_10.42.42.5(pid=24113): Launched 20:24:09.479334 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:10.196368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24115): Launched 20:24:10.533040 run osmo-msc_10.42.42.6(pid=24116): Launched 20:24:10.903169 run osmo-stp_10.42.42.5(pid=24113): ERR: Terminated: ERROR {rc=1} [trial-2381↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24113)] 20:24:11.178056 run osmo-stp_10.42.42.5(pid=24113): stdout: | (launched: 2022-12-12_20:24:09.168849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:11.414773 run osmo-stp_10.42.42.5(pid=24113): stderr: | 20221212202409499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202409499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202409499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202409499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202409500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202409500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202409500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:11.543983 run osmo-stp_10.42.42.5(pid=24113): stdout: | (launched: 2022-12-12_20:24:09.168849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:11.668001 run osmo-stp_10.42.42.5(pid=24113): stderr: | 20221212202409499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202409499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202409499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202409499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202409500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202409500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202409500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:11.816008 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24113): Process ended prematurely: osmo-stp_10.42.42.5(pid=24113) [trial-2381↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24113)] [trial-2381↪encryption↪register_a5_1_authreq.py:8] 20:24:11.825025 tst register_a5_1_authreq.py:8: Test FAILED (7.4 sec) 20:24:11.851741 run osmo-hlr_10.42.42.2(pid=24110): ERR: Terminated: ERROR {rc=237} [trial-2381↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24110)] 20:24:11.900471 run osmo-hlr_10.42.42.2(pid=24110): stdout: | (launched: 2022-12-12_20:24:07.857306) 20:24:11.950660 run osmo-hlr_10.42.42.2(pid=24110): stderr: | 20221212202408194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202408194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202408194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202408194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202408194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202408195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202408215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202408223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202408223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202408224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:12.020847 run osmo-msc_10.42.42.6(pid=24116): ERR: Terminated: ERROR {rc=2} [trial-2381↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24116)] 20:24:12.069253 run osmo-msc_10.42.42.6(pid=24116): stdout: | (launched: 2022-12-12_20:24:10.473401) 20:24:12.119486 run osmo-msc_10.42.42.6(pid=24116): stderr: | 20221212202411070 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202411070 DLGLOBAL DEBUG validating counter group 0x7fef51c52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202411070 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202411070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202411070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202411071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202411072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202411073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202411073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202411073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:12.170062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24109): Terminating (SIGTERM) 20:24:12.210125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24112): Terminating (SIGTERM) 20:24:12.250320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24115): Terminating (SIGTERM) 20:24:12.290765 --- ParallelTerminationStrategy: PID 24109 died... 20:24:12.310196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24109): Terminated: ok {rc=0} 20:24:12.354751 --- ParallelTerminationStrategy: PID 24112 died... 20:24:12.373670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24112): Terminated: ok {rc=0} 20:24:12.418053 --- ParallelTerminationStrategy: PID 24115 died... 20:24:12.436906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24115): Terminated: ok {rc=0} 20:24:12.521998 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2381 encryption register_a5_3_authreq.py ---------------------------------------------- 20:24:13.675044 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:13.686828 tst encryption: Using 1 x bts (candidates: 1) 20:24:13.725216 tst register_a5_3_authreq.py: using LAC 31286 20:24:13.855324 tst register_a5_3_authreq.py: using RAC 176 20:24:13.987036 tst register_a5_3_authreq.py: using CellId 31286 20:24:14.119020 tst register_a5_3_authreq.py: using BVCI 31287 20:24:14.242156 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:14.253275 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:14.264128 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:14.275344 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:14.286510 tst encryption: Using 1 x ip_address (candidates: 6) 20:24:14.297653 tst encryption: Using 1 x modem (candidates: 1) 20:24:14.430222 tst register_a5_3_authreq.py:8: start network... 20:24:14.655456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:15.168697 run create_hlr_db(pid=24120): Launched 20:24:15.295980 bus /sierra_2: Setting Powered False 20:24:16.379406 run create_hlr_db(pid=24120): Terminated: ok {rc=0} 20:24:16.876011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24122): Launched 20:24:17.222907 run osmo-hlr_10.42.42.2(pid=24123): Launched 20:24:17.352940 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:17.893144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24125): Launched 20:24:18.203594 run osmo-stp_10.42.42.5(pid=24126): Launched 20:24:18.320735 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:18.879256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24128): Launched 20:24:19.189983 run osmo-msc_10.42.42.6(pid=24129): Launched 20:24:19.367375 run osmo-stp_10.42.42.5(pid=24126): ERR: Terminated: ERROR {rc=1} [trial-2381↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24126)] 20:24:19.498024 run osmo-stp_10.42.42.5(pid=24126): stdout: | (launched: 2022-12-12_20:24:18.146369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:19.628495 run osmo-stp_10.42.42.5(pid=24126): stderr: | 20221212202418317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202418317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202418317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202418318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202418318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202418318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202418318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:19.757059 run osmo-stp_10.42.42.5(pid=24126): stdout: | (launched: 2022-12-12_20:24:18.146369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:19.880173 run osmo-stp_10.42.42.5(pid=24126): stderr: | 20221212202418317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202418317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202418317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202418318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202418318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202418318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202418318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:20.027761 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24126): Process ended prematurely: osmo-stp_10.42.42.5(pid=24126) [trial-2381↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24126)] [trial-2381↪encryption↪register_a5_3_authreq.py:8] 20:24:20.036592 tst register_a5_3_authreq.py:8: Test FAILED (6.4 sec) 20:24:20.062888 run osmo-hlr_10.42.42.2(pid=24123): ERR: Terminated: ERROR {rc=237} [trial-2381↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24123)] 20:24:20.110912 run osmo-hlr_10.42.42.2(pid=24123): stdout: | (launched: 2022-12-12_20:24:17.164260) 20:24:20.160545 run osmo-hlr_10.42.42.2(pid=24123): stderr: | 20221212202417359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202417359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202417359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202417359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202417359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202417359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202417372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202417380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202417381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202417381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:20.229787 run osmo-msc_10.42.42.6(pid=24129): ERR: Terminated: ERROR {rc=2} [trial-2381↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24129)] 20:24:20.277442 run osmo-msc_10.42.42.6(pid=24129): stdout: | (launched: 2022-12-12_20:24:19.132252) 20:24:20.327160 run osmo-msc_10.42.42.6(pid=24129): stderr: | 20221212202419409 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202419409 DLGLOBAL DEBUG validating counter group 0x7f45e972cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202419409 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202419409 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202419409 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202419409 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202419411 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202419411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202419412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202419412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:20.377322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24122): Terminating (SIGTERM) 20:24:20.416828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24125): Terminating (SIGTERM) 20:24:20.456704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24128): Terminating (SIGTERM) 20:24:20.496507 --- ParallelTerminationStrategy: PID 24122 died... 20:24:20.515629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24122): Terminated: ok {rc=0} 20:24:20.559368 --- ParallelTerminationStrategy: PID 24125 died... 20:24:20.577919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24125): Terminated: ok {rc=0} 20:24:20.621658 --- ParallelTerminationStrategy: PID 24128 died... 20:24:20.640079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24128): Terminated: ok {rc=0} 20:24:20.723739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 20:24:21.934178 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:24:21.939818 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 20:24:21.958260 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 20:24:21.985020 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 20:24:22.014662 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 20:24:22.033237 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 20:24:22.059272 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 20:24:22.569223 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 20:24:22.573816 tst handover.py:11: TEST_CONFIG: {} 20:24:22.778693 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 20:24:22.794658 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 20:24:22.817475 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 20:24:22.869234 tst handover.py: using MSISDN 7958 20:24:22.993515 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7958', subscriber_id=0} 20:24:23.109021 run srsepc_10.42.42.118: Starting srsepc 20:24:25.034217 run rm-remote-dir(pid=24134): Launched 20:24:25.166470 bus /sierra_2: Setting Powered False 20:24:26.235744 run rm-remote-dir(pid=24134): Terminated: ok {rc=0} 20:24:26.694203 run mk-remote-dir(pid=24135): Launched 20:24:27.876578 run mk-remote-dir(pid=24135): Terminated: ok {rc=0} 20:24:28.171173 run scp-inst-to-remote(pid=24136): Launched 20:24:30.358912 run scp-inst-to-remote(pid=24136): Terminated: ok {rc=0} 20:24:30.721947 run rm-remote-dir(pid=24138): Launched 20:24:31.935760 run rm-remote-dir(pid=24138): Terminated: ok {rc=0} 20:24:32.360628 run mk-remote-dir(pid=24139): Launched 20:24:33.556301 run mk-remote-dir(pid=24139): Terminated: ok {rc=0} 20:24:33.867584 run scp-cfg-to-remote(pid=24140): Launched 20:24:35.059514 run scp-cfg-to-remote(pid=24140): Terminated: ok {rc=0} 20:24:35.368721 run scp-db-to-remote(pid=24142): Launched 20:24:36.560046 run scp-db-to-remote(pid=24142): Terminated: ok {rc=0} 20:24:36.702603 run srsepc_10.42.42.118: Setting RPATH for srsepc 20:24:37.037633 run patchelf(pid=24144): Launched 20:24:38.228134 run patchelf(pid=24144): Terminated: ok {rc=0} 20:24:38.370963 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 20:24:38.706728 run setcap-netadm(pid=24145): Launched 20:24:39.897521 run setcap-netadm(pid=24145): Terminated: ok {rc=0} 20:24:40.248098 run srsepc(pid=24146): Launched 20:24:40.373520 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 20:24:41.565760 run rm-remote-dir(pid=24147): Launched 20:24:41.755657 run srsepc(pid=24146): ERR: Terminated: ERROR {rc=127} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24146)] 20:24:41.902644 run srsepc(pid=24146): stdout: | (launched: 2022-12-12_20:24:40.186867) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:24:42.050564 run srsepc(pid=24146): stderr: | (launched: 2022-12-12_20:24:40.235998) | Connection to 10.42.42.116 closed. 20:24:42.196509 run srsepc(pid=24146): stdout: | (launched: 2022-12-12_20:24:40.186867) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:24:42.336178 run srsepc(pid=24146): stderr: | (launched: 2022-12-12_20:24:40.235998) | Connection to 10.42.42.116 closed. 20:24:42.501788 run rm-remote-dir(pid=24147): Terminating (SIGINT) 20:24:42.692752 run rm-remote-dir(pid=24147): Terminated: ok {rc=0} 20:24:42.830819 tst handover.py:37: ERR: Error: srsepc(pid=24146): Process ended prematurely: srsepc(pid=24146) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24146)] [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 20:24:42.841470 tst handover.py:37: Test FAILED (20.3 sec) 20:24:42.924495 run scp-back-log(pid=24148): Launched 20:24:44.008868 run scp-back-log(pid=24148): ERR: Terminated: ERROR {rc=1} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24148)] 20:24:44.073957 run scp-back-log(pid=24148): stdout: | (launched: 2022-12-12_20:24:42.891406) 20:24:44.140680 run scp-back-log(pid=24148): stderr: | (launched: 2022-12-12_20:24:42.912421) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 20:24:44.215788 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24148): launch_sync(): local process exited with status 1 [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24148)]') ---------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 20:24:44.263953 tst iperf3_bidir.py:13: Number of physical ue: 1 20:24:44.488014 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 20:24:44.532113 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 20:24:44.754453 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 20:24:44.770882 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 20:24:44.804346 tst iperf3_bidir.py: using MSISDN 7959 20:24:44.923946 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7959', subscriber_id=0} 20:24:45.039808 run srsepc_10.42.42.118: Starting srsepc 20:24:45.720710 run rm-remote-dir(pid=24150): Launched 20:24:46.933193 run rm-remote-dir(pid=24150): Terminated: ok {rc=0} 20:24:47.306773 run mk-remote-dir(pid=24151): Launched 20:24:48.500440 run mk-remote-dir(pid=24151): Terminated: ok {rc=0} 20:24:48.811621 run scp-inst-to-remote(pid=24152): Launched 20:24:51.003887 run scp-inst-to-remote(pid=24152): Terminated: ok {rc=0} 20:24:51.367113 run rm-remote-dir(pid=24156): Launched 20:24:52.560475 run rm-remote-dir(pid=24156): Terminated: ok {rc=0} 20:24:52.925011 run mk-remote-dir(pid=24157): Launched 20:24:54.118372 run mk-remote-dir(pid=24157): Terminated: ok {rc=0} 20:24:54.429601 run scp-cfg-to-remote(pid=24158): Launched 20:24:55.620831 run scp-cfg-to-remote(pid=24158): Terminated: ok {rc=0} 20:24:55.930294 run scp-db-to-remote(pid=24160): Launched 20:24:57.121445 run scp-db-to-remote(pid=24160): Terminated: ok {rc=0} 20:24:57.263779 run srsepc_10.42.42.118: Setting RPATH for srsepc 20:24:57.615775 run patchelf(pid=24162): Launched 20:24:58.807657 run patchelf(pid=24162): Terminated: ok {rc=0} 20:24:58.950576 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 20:24:59.285067 run setcap-netadm(pid=24163): Launched 20:25:00.476302 run setcap-netadm(pid=24163): Terminated: ok {rc=0} 20:25:00.827390 run srsepc(pid=24164): Launched 20:25:01.002357 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 20:25:02.252081 run rm-remote-dir(pid=24168): Launched 20:25:02.444418 run srsepc(pid=24164): ERR: Terminated: ERROR {rc=127} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24164)] 20:25:02.590061 run srsepc(pid=24164): stdout: | (launched: 2022-12-12_20:25:00.766050) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:25:02.736552 run srsepc(pid=24164): stderr: | (launched: 2022-12-12_20:25:00.815310) | Connection to 10.42.42.116 closed. 20:25:02.882691 run srsepc(pid=24164): stdout: | (launched: 2022-12-12_20:25:00.766050) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:25:03.022919 run srsepc(pid=24164): stderr: | (launched: 2022-12-12_20:25:00.815310) | Connection to 10.42.42.116 closed. 20:25:03.189119 run rm-remote-dir(pid=24168): Terminating (SIGINT) 20:25:03.380539 run rm-remote-dir(pid=24168): Terminated: ok {rc=0} 20:25:03.518599 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=24164): Process ended prematurely: srsepc(pid=24164) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24164)] [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 20:25:03.529350 tst iperf3_bidir.py:42: Test FAILED (19.3 sec) 20:25:03.613212 run scp-back-log(pid=24169): Launched 20:25:04.696773 run scp-back-log(pid=24169): ERR: Terminated: ERROR {rc=1} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24169)] 20:25:04.761716 run scp-back-log(pid=24169): stdout: | (launched: 2022-12-12_20:25:03.579809) 20:25:04.828428 run scp-back-log(pid=24169): stderr: | (launched: 2022-12-12_20:25:03.601073) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 20:25:04.903016 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24169): launch_sync(): local process exited with status 1 [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24169)]') ---------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 20:25:04.951007 tst iperf3_dl.py:13: Number of physical ue: 1 20:25:05.174934 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 20:25:05.220885 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 20:25:05.442067 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 20:25:05.458618 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 20:25:05.493199 tst iperf3_dl.py: using MSISDN 7960 20:25:05.606142 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7960', subscriber_id=0} 20:25:05.713517 run srsepc_10.42.42.118: Starting srsepc 20:25:06.346574 run rm-remote-dir(pid=24171): Launched 20:25:07.529372 run rm-remote-dir(pid=24171): Terminated: ok {rc=0} 20:25:07.870318 run mk-remote-dir(pid=24172): Launched 20:25:09.052498 run mk-remote-dir(pid=24172): Terminated: ok {rc=0} 20:25:09.343171 run scp-inst-to-remote(pid=24173): Launched 20:25:11.531533 run scp-inst-to-remote(pid=24173): Terminated: ok {rc=0} 20:25:11.894934 run rm-remote-dir(pid=24175): Launched 20:25:13.088581 run rm-remote-dir(pid=24175): Terminated: ok {rc=0} 20:25:13.452746 run mk-remote-dir(pid=24176): Launched 20:25:14.646945 run mk-remote-dir(pid=24176): Terminated: ok {rc=0} 20:25:14.956493 run scp-cfg-to-remote(pid=24177): Launched 20:25:16.145740 run scp-cfg-to-remote(pid=24177): Terminated: ok {rc=0} 20:25:16.461329 run scp-db-to-remote(pid=24179): Launched 20:25:17.724045 run scp-db-to-remote(pid=24179): Terminated: ok {rc=0} 20:25:17.867130 run srsepc_10.42.42.118: Setting RPATH for srsepc 20:25:18.203252 run patchelf(pid=24181): Launched 20:25:19.394895 run patchelf(pid=24181): Terminated: ok {rc=0} 20:25:19.537949 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 20:25:19.873756 run setcap-netadm(pid=24182): Launched 20:25:21.065172 run setcap-netadm(pid=24182): Terminated: ok {rc=0} 20:25:21.416093 run srsepc(pid=24183): Launched 20:25:21.541148 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 20:25:22.737193 run rm-remote-dir(pid=24184): Launched 20:25:22.929622 run srsepc(pid=24183): ERR: Terminated: ERROR {rc=127} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24183)] 20:25:23.074822 run srsepc(pid=24183): stdout: | (launched: 2022-12-12_20:25:21.354483) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:25:23.220819 run srsepc(pid=24183): stderr: | (launched: 2022-12-12_20:25:21.403946) | Connection to 10.42.42.116 closed. 20:25:23.367371 run srsepc(pid=24183): stdout: | (launched: 2022-12-12_20:25:21.354483) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:25:23.507889 run srsepc(pid=24183): stderr: | (launched: 2022-12-12_20:25:21.403946) | Connection to 10.42.42.116 closed. 20:25:23.673919 run rm-remote-dir(pid=24184): Terminating (SIGINT) 20:25:23.866032 run rm-remote-dir(pid=24184): Terminated: ok {rc=0} 20:25:24.004327 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=24183): Process ended prematurely: srsepc(pid=24183) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24183)] [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 20:25:24.015180 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 20:25:24.099046 run scp-back-log(pid=24185): Launched 20:25:25.180635 run scp-back-log(pid=24185): ERR: Terminated: ERROR {rc=1} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24185)] 20:25:25.245564 run scp-back-log(pid=24185): stdout: | (launched: 2022-12-12_20:25:24.065490) 20:25:25.312135 run scp-back-log(pid=24185): stderr: | (launched: 2022-12-12_20:25:24.086514) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 20:25:25.387385 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24185): launch_sync(): local process exited with status 1 [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24185)]') ---------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 20:25:25.435610 tst iperf3_ul.py:13: Number of physical ue: 1 20:25:25.659340 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 20:25:25.703197 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 20:25:25.926317 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 20:25:25.942870 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 20:25:25.976726 tst iperf3_ul.py: using MSISDN 7961 20:25:26.098512 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7961', subscriber_id=0} 20:25:26.214771 run srsepc_10.42.42.118: Starting srsepc 20:25:26.894906 run rm-remote-dir(pid=24187): Launched 20:25:28.088533 run rm-remote-dir(pid=24187): Terminated: ok {rc=0} 20:25:28.453558 run mk-remote-dir(pid=24188): Launched 20:25:29.646893 run mk-remote-dir(pid=24188): Terminated: ok {rc=0} 20:25:29.958278 run scp-inst-to-remote(pid=24189): Launched 20:25:32.162181 run scp-inst-to-remote(pid=24189): Terminated: ok {rc=0} 20:25:32.597755 run rm-remote-dir(pid=24191): Launched 20:25:33.802456 run rm-remote-dir(pid=24191): Terminated: ok {rc=0} 20:25:34.143012 run mk-remote-dir(pid=24192): Launched 20:25:35.325769 run mk-remote-dir(pid=24192): Terminated: ok {rc=0} 20:25:35.616418 run scp-cfg-to-remote(pid=24193): Launched 20:25:36.796139 run scp-cfg-to-remote(pid=24193): Terminated: ok {rc=0} 20:25:37.085314 run scp-db-to-remote(pid=24195): Launched 20:25:38.266761 run scp-db-to-remote(pid=24195): Terminated: ok {rc=0} 20:25:38.399490 run srsepc_10.42.42.118: Setting RPATH for srsepc 20:25:38.712193 run patchelf(pid=24197): Launched 20:25:39.893649 run patchelf(pid=24197): Terminated: ok {rc=0} 20:25:40.028615 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 20:25:40.341099 run setcap-netadm(pid=24198): Launched 20:25:41.520497 run setcap-netadm(pid=24198): Terminated: ok {rc=0} 20:25:41.848329 run srsepc(pid=24199): Launched 20:25:41.974239 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 20:25:43.173228 run rm-remote-dir(pid=24200): Launched 20:25:43.365847 run srsepc(pid=24199): ERR: Terminated: ERROR {rc=127} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24199)] 20:25:43.512200 run srsepc(pid=24199): stdout: | (launched: 2022-12-12_20:25:41.790522) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:25:43.659176 run srsepc(pid=24199): stderr: | (launched: 2022-12-12_20:25:41.836527) | Connection to 10.42.42.116 closed. 20:25:43.805966 run srsepc(pid=24199): stdout: | (launched: 2022-12-12_20:25:41.790522) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:25:43.946900 run srsepc(pid=24199): stderr: | (launched: 2022-12-12_20:25:41.836527) | Connection to 10.42.42.116 closed. 20:25:44.113532 run rm-remote-dir(pid=24200): Terminating (SIGINT) 20:25:44.305284 run rm-remote-dir(pid=24200): Terminated: ok {rc=0} 20:25:44.444633 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=24199): Process ended prematurely: srsepc(pid=24199) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24199)] [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 20:25:44.455404 tst iperf3_ul.py:42: Test FAILED (19.0 sec) 20:25:44.538591 run scp-back-log(pid=24201): Launched 20:25:45.620315 run scp-back-log(pid=24201): ERR: Terminated: ERROR {rc=1} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24201)] 20:25:45.686013 run scp-back-log(pid=24201): stdout: | (launched: 2022-12-12_20:25:44.505474) 20:25:45.752862 run scp-back-log(pid=24201): stderr: | (launched: 2022-12-12_20:25:44.526502) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 20:25:45.828229 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24201): launch_sync(): local process exited with status 1 [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24201)]') ---------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 20:25:45.887366 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 20:25:45.908376 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 20:25:45.942441 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 20:25:45.992454 tst ping.py: using MSISDN 7962 20:25:46.149349 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7962', subscriber_id=0} 20:25:46.296425 run srsepc_10.42.42.118: Starting srsepc 20:25:46.991522 run rm-remote-dir(pid=24203): Launched 20:25:48.237808 run rm-remote-dir(pid=24203): Terminated: ok {rc=0} 20:25:48.601484 run mk-remote-dir(pid=24204): Launched 20:25:49.795205 run mk-remote-dir(pid=24204): Terminated: ok {rc=0} 20:25:50.105715 run scp-inst-to-remote(pid=24205): Launched 20:25:52.297630 run scp-inst-to-remote(pid=24205): Terminated: ok {rc=0} 20:25:52.660181 run rm-remote-dir(pid=24207): Launched 20:25:53.854353 run rm-remote-dir(pid=24207): Terminated: ok {rc=0} 20:25:54.217667 run mk-remote-dir(pid=24208): Launched 20:25:55.412428 run mk-remote-dir(pid=24208): Terminated: ok {rc=0} 20:25:55.722612 run scp-cfg-to-remote(pid=24209): Launched 20:25:56.913303 run scp-cfg-to-remote(pid=24209): Terminated: ok {rc=0} 20:25:57.225129 run scp-db-to-remote(pid=24211): Launched 20:25:58.408495 run scp-db-to-remote(pid=24211): Terminated: ok {rc=0} 20:25:58.541155 run srsepc_10.42.42.118: Setting RPATH for srsepc 20:25:58.851885 run patchelf(pid=24213): Launched 20:26:00.031666 run patchelf(pid=24213): Terminated: ok {rc=0} 20:26:00.164016 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 20:26:00.474938 run setcap-netadm(pid=24214): Launched 20:26:01.670760 run setcap-netadm(pid=24214): Terminated: ok {rc=0} 20:26:02.025162 run srsepc(pid=24215): Launched 20:26:02.195218 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 20:26:03.411130 run rm-remote-dir(pid=24216): Launched 20:26:03.602053 run srsepc(pid=24215): ERR: Terminated: ERROR {rc=127} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24215)] 20:26:03.747563 run srsepc(pid=24215): stdout: | (launched: 2022-12-12_20:26:01.966751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:26:03.894243 run srsepc(pid=24215): stderr: | (launched: 2022-12-12_20:26:02.013394) | Connection to 10.42.42.116 closed. 20:26:04.041029 run srsepc(pid=24215): stdout: | (launched: 2022-12-12_20:26:01.966751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:26:04.181671 run srsepc(pid=24215): stderr: | (launched: 2022-12-12_20:26:02.013394) | Connection to 10.42.42.116 closed. 20:26:04.348143 run rm-remote-dir(pid=24216): Terminating (SIGINT) 20:26:04.540541 run rm-remote-dir(pid=24216): Terminated: ok {rc=0} 20:26:04.679290 tst ping.py:16: ERR: Error: srsepc(pid=24215): Process ended prematurely: srsepc(pid=24215) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24215)] [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 20:26:04.690256 tst ping.py:16: Test FAILED (18.8 sec) 20:26:04.773567 run scp-back-log(pid=24217): Launched 20:26:05.857274 run scp-back-log(pid=24217): ERR: Terminated: ERROR {rc=1} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24217)] 20:26:05.922547 run scp-back-log(pid=24217): stdout: | (launched: 2022-12-12_20:26:04.740393) 20:26:05.989298 run scp-back-log(pid=24217): stderr: | (launched: 2022-12-12_20:26:04.761481) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 20:26:06.064187 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24217): launch_sync(): local process exited with status 1 [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24217)]') ---------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 20:26:06.113416 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 20:26:06.130749 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 20:26:06.154862 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 20:26:06.207674 tst rrc_idle_mo_ping.py: using MSISDN 7963 20:26:06.331315 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7963', subscriber_id=0} 20:26:06.447330 run srsepc_10.42.42.118: Starting srsepc 20:26:07.125581 run rm-remote-dir(pid=24219): Launched 20:26:08.320216 run rm-remote-dir(pid=24219): Terminated: ok {rc=0} 20:26:08.685316 run mk-remote-dir(pid=24220): Launched 20:26:09.879332 run mk-remote-dir(pid=24220): Terminated: ok {rc=0} 20:26:10.189917 run scp-inst-to-remote(pid=24221): Launched 20:26:12.382920 run scp-inst-to-remote(pid=24221): Terminated: ok {rc=0} 20:26:12.745109 run rm-remote-dir(pid=24223): Launched 20:26:13.940130 run rm-remote-dir(pid=24223): Terminated: ok {rc=0} 20:26:14.305760 run mk-remote-dir(pid=24224): Launched 20:26:15.502072 run mk-remote-dir(pid=24224): Terminated: ok {rc=0} 20:26:15.811954 run scp-cfg-to-remote(pid=24225): Launched 20:26:17.081264 run scp-cfg-to-remote(pid=24225): Terminated: ok {rc=0} 20:26:17.408342 run scp-db-to-remote(pid=24227): Launched 20:26:18.591134 run scp-db-to-remote(pid=24227): Terminated: ok {rc=0} 20:26:18.723654 run srsepc_10.42.42.118: Setting RPATH for srsepc 20:26:19.034986 run patchelf(pid=24229): Launched 20:26:20.215530 run patchelf(pid=24229): Terminated: ok {rc=0} 20:26:20.348284 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 20:26:20.660341 run setcap-netadm(pid=24230): Launched 20:26:21.840431 run setcap-netadm(pid=24230): Terminated: ok {rc=0} 20:26:22.167415 run srsepc(pid=24231): Launched 20:26:22.283906 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 20:26:23.402561 run rm-remote-dir(pid=24232): Launched 20:26:23.583067 run srsepc(pid=24231): ERR: Terminated: ERROR {rc=127} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24231)] 20:26:23.720417 run srsepc(pid=24231): stdout: | (launched: 2022-12-12_20:26:22.109640) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:26:23.857305 run srsepc(pid=24231): stderr: | (launched: 2022-12-12_20:26:22.155532) | Connection to 10.42.42.116 closed. 20:26:23.993772 run srsepc(pid=24231): stdout: | (launched: 2022-12-12_20:26:22.109640) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:26:24.123711 run srsepc(pid=24231): stderr: | (launched: 2022-12-12_20:26:22.155532) | Connection to 10.42.42.116 closed. 20:26:24.278509 run rm-remote-dir(pid=24232): Terminating (SIGINT) 20:26:24.458011 run rm-remote-dir(pid=24232): Terminated: ok {rc=0} 20:26:24.587313 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=24231): Process ended prematurely: srsepc(pid=24231) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24231)] [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 20:26:24.597310 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 20:26:24.675743 run scp-back-log(pid=24233): Launched 20:26:25.754178 run scp-back-log(pid=24233): ERR: Terminated: ERROR {rc=1} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24233)] 20:26:25.814955 run scp-back-log(pid=24233): stdout: | (launched: 2022-12-12_20:26:24.644115) 20:26:25.877615 run scp-back-log(pid=24233): stderr: | (launched: 2022-12-12_20:26:24.664050) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 20:26:25.948108 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24233): launch_sync(): local process exited with status 1 [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24233)]') ---------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 20:26:25.993877 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 20:26:26.010612 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 20:26:26.033394 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 20:26:26.081157 tst rrc_idle_mt_ping.py: using MSISDN 7964 20:26:26.196034 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7964', subscriber_id=0} 20:26:26.303685 run srsepc_10.42.42.118: Starting srsepc 20:26:26.936070 run rm-remote-dir(pid=24235): Launched 20:26:28.118169 run rm-remote-dir(pid=24235): Terminated: ok {rc=0} 20:26:28.458645 run mk-remote-dir(pid=24236): Launched 20:26:29.640579 run mk-remote-dir(pid=24236): Terminated: ok {rc=0} 20:26:29.931174 run scp-inst-to-remote(pid=24237): Launched 20:26:32.132774 run scp-inst-to-remote(pid=24237): Terminated: ok {rc=0} 20:26:32.533036 run rm-remote-dir(pid=24239): Launched 20:26:33.736536 run rm-remote-dir(pid=24239): Terminated: ok {rc=0} 20:26:34.100467 run mk-remote-dir(pid=24240): Launched 20:26:35.295085 run mk-remote-dir(pid=24240): Terminated: ok {rc=0} 20:26:35.606014 run scp-cfg-to-remote(pid=24241): Launched 20:26:36.798620 run scp-cfg-to-remote(pid=24241): Terminated: ok {rc=0} 20:26:37.107670 run scp-db-to-remote(pid=24243): Launched 20:26:38.298460 run scp-db-to-remote(pid=24243): Terminated: ok {rc=0} 20:26:38.441891 run srsepc_10.42.42.118: Setting RPATH for srsepc 20:26:38.776150 run patchelf(pid=24245): Launched 20:26:39.967195 run patchelf(pid=24245): Terminated: ok {rc=0} 20:26:40.109639 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 20:26:40.445128 run setcap-netadm(pid=24246): Launched 20:26:41.637748 run setcap-netadm(pid=24246): Terminated: ok {rc=0} 20:26:41.988105 run srsepc(pid=24247): Launched 20:26:42.113449 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 20:26:43.310016 run rm-remote-dir(pid=24248): Launched 20:26:43.502329 run srsepc(pid=24247): ERR: Terminated: ERROR {rc=127} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24247)] 20:26:43.648001 run srsepc(pid=24247): stdout: | (launched: 2022-12-12_20:26:41.926934) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:26:43.794312 run srsepc(pid=24247): stderr: | (launched: 2022-12-12_20:26:41.975866) | Connection to 10.42.42.116 closed. 20:26:43.940515 run srsepc(pid=24247): stdout: | (launched: 2022-12-12_20:26:41.926934) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 20:26:44.080361 run srsepc(pid=24247): stderr: | (launched: 2022-12-12_20:26:41.975866) | Connection to 10.42.42.116 closed. 20:26:44.245915 run rm-remote-dir(pid=24248): Terminating (SIGINT) 20:26:44.438590 run rm-remote-dir(pid=24248): Terminated: ok {rc=0} 20:26:44.577276 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=24247): Process ended prematurely: srsepc(pid=24247) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24247)] [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 20:26:44.588173 tst rrc_idle_mt_ping.py:16: Test FAILED (18.6 sec) 20:26:44.671619 run scp-back-log(pid=24249): Launched 20:26:45.755409 run scp-back-log(pid=24249): ERR: Terminated: ERROR {rc=1} [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24249)] 20:26:45.820594 run scp-back-log(pid=24249): stdout: | (launched: 2022-12-12_20:26:44.638212) 20:26:45.906183 run scp-back-log(pid=24249): stderr: | (launched: 2022-12-12_20:26:44.659277) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 20:26:45.982188 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24249): launch_sync(): local process exited with status 1 [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24249)]') --------------------------------------------------------------------- trial-2381 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 20:26:46.120993 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:26:46.127023 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 20:26:46.173183 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 20:26:46.202235 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 20:26:46.257211 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 20:26:46.312068 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 20:26:46.347858 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 20:26:46.880920 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 20:26:46.888255 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 20:26:46.900668 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 20:26:46.946849 tst handover.py: using LAC 31287 20:26:47.082658 tst handover.py: using RAC 177 20:26:47.213026 tst handover.py: using CellId 31287 20:26:47.332477 tst handover.py: using BVCI 31288 20:26:47.443500 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 20:26:47.476928 tst handover.py: using LAC 31288 20:26:47.605967 tst handover.py: using RAC 178 20:26:47.734874 tst handover.py: using CellId 31288 20:26:47.861577 tst handover.py: using BVCI 31289 20:26:47.974561 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 20:26:47.985640 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 20:26:47.996366 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 20:26:48.007162 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 20:26:48.017929 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 20:26:48.028683 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 20:26:48.149128 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 20:26:48.268771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:48.777247 run create_hlr_db(pid=24254): Launched 20:26:49.967681 run create_hlr_db(pid=24254): Terminated: ok {rc=0} 20:26:50.313990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24256): Launched 20:26:50.643718 run osmo-hlr_10.42.42.2(pid=24257): Launched 20:26:50.770491 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:51.333698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24259): Launched 20:26:51.662556 run osmo-stp_10.42.42.5(pid=24260): Launched 20:26:51.788070 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:52.381481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24262): Launched 20:26:52.711639 run osmo-msc_10.42.42.6(pid=24263): Launched 20:26:52.895869 run osmo-stp_10.42.42.5(pid=24260): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24260)] 20:26:53.034761 run osmo-stp_10.42.42.5(pid=24260): stdout: | (launched: 2022-12-12_20:26:51.601788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:53.173751 run osmo-stp_10.42.42.5(pid=24260): stderr: | 20221212202651794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202651794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202651794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202651794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202651795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202651795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202651795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:53.310506 run osmo-stp_10.42.42.5(pid=24260): stdout: | (launched: 2022-12-12_20:26:51.601788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:53.441470 run osmo-stp_10.42.42.5(pid=24260): stderr: | 20221212202651794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202651794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202651794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202651794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202651795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202651795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202651795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:53.597842 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24260): Process ended prematurely: osmo-stp_10.42.42.5(pid=24260) [trial-2381↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24260)] [trial-2381↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 20:26:53.607008 tst handover.py:18: Test FAILED (6.7 sec) 20:26:53.635190 run osmo-hlr_10.42.42.2(pid=24257): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24257)] 20:26:53.686348 run osmo-hlr_10.42.42.2(pid=24257): stdout: | (launched: 2022-12-12_20:26:50.583685) 20:26:53.739015 run osmo-hlr_10.42.42.2(pid=24257): stderr: | 20221212202650782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202650782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202650782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202650782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202650782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202650782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202650795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202650803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202650803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202650803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:53.812504 run osmo-msc_10.42.42.6(pid=24263): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24263)] 20:26:53.863339 run osmo-msc_10.42.42.6(pid=24263): stdout: | (launched: 2022-12-12_20:26:52.651432) 20:26:53.916076 run osmo-msc_10.42.42.6(pid=24263): stderr: | 20221212202652971 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202652971 DLGLOBAL DEBUG validating counter group 0x7f95f4599c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202652971 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202652971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202652971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202652971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202652973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202652973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202652974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202652974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:53.968843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24256): Terminating (SIGTERM) 20:26:54.011176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24259): Terminating (SIGTERM) 20:26:54.053598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24262): Terminating (SIGTERM) 20:26:54.096505 --- ParallelTerminationStrategy: PID 24256 died... 20:26:54.116766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24256): Terminated: ok {rc=0} 20:26:54.164350 --- ParallelTerminationStrategy: PID 24259 died... 20:26:54.184194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24259): Terminated: ok {rc=0} 20:26:54.231169 --- ParallelTerminationStrategy: PID 24262 died... 20:26:54.250821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24262): Terminated: ok {rc=0} 20:26:54.340431 bus /sierra_3: Setting Powered False 20:26:55.438750 bus /sierra_3: Setting Powered False 20:26:56.555450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 20:26:57.811011 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:26:57.816563 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 20:26:57.858051 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 20:26:57.885843 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 20:26:57.939386 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 20:26:57.980274 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 20:26:58.007807 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 20:26:58.566388 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 20:26:58.572423 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:26:58.584652 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 20:26:58.624027 tst handover.py: using LAC 31289 20:26:58.750402 tst handover.py: using RAC 179 20:26:58.876333 tst handover.py: using CellId 31289 20:26:58.995262 tst handover.py: using BVCI 31290 20:26:59.105217 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 20:26:59.138289 tst handover.py: using LAC 31290 20:26:59.261267 tst handover.py: using RAC 180 20:26:59.378072 tst handover.py: using CellId 31290 20:26:59.497873 tst handover.py: using BVCI 31291 20:26:59.608031 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:26:59.618856 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:26:59.629682 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:26:59.640586 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:26:59.651272 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:26:59.661865 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 20:26:59.781300 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 20:26:59.900879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:00.379312 run create_hlr_db(pid=24271): Launched 20:27:00.513629 bus /sierra_2: Setting Powered False 20:27:01.577747 run create_hlr_db(pid=24271): Terminated: ok {rc=0} 20:27:02.017670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Launched 20:27:02.361475 run osmo-hlr_10.42.42.2(pid=24274): Launched 20:27:02.488361 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:03.024543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Launched 20:27:03.352688 run osmo-stp_10.42.42.5(pid=24277): Launched 20:27:03.477836 run osmo-msc_10.42.42.6: Starting osmo-msc 20:27:04.042296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24279): Launched 20:27:04.371701 run osmo-msc_10.42.42.6(pid=24280): Launched 20:27:04.557982 run osmo-stp_10.42.42.5(pid=24277): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] 20:27:04.695744 run osmo-stp_10.42.42.5(pid=24277): stdout: | (launched: 2022-12-12_20:27:03.291754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:04.834672 run osmo-stp_10.42.42.5(pid=24277): stderr: | 20221212202703483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202703484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202703484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202703484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202703485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202703485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202703485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:04.971784 run osmo-stp_10.42.42.5(pid=24277): stdout: | (launched: 2022-12-12_20:27:03.291754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:05.102773 run osmo-stp_10.42.42.5(pid=24277): stderr: | 20221212202703483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202703484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202703484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202703484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202703485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202703485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202703485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:05.259160 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24277): Process ended prematurely: osmo-stp_10.42.42.5(pid=24277) [trial-2381↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] [trial-2381↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 20:27:05.268231 tst handover.py:18: Test FAILED (6.7 sec) 20:27:05.296107 run osmo-hlr_10.42.42.2(pid=24274): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24274)] 20:27:05.346883 run osmo-hlr_10.42.42.2(pid=24274): stdout: | (launched: 2022-12-12_20:27:02.300635) 20:27:05.399605 run osmo-hlr_10.42.42.2(pid=24274): stderr: | 20221212202702500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202702500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202702500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202702500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202702500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202702500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202702539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202702550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202702550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202702550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:05.472802 run osmo-msc_10.42.42.6(pid=24280): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24280)] 20:27:05.523064 run osmo-msc_10.42.42.6(pid=24280): stdout: | (launched: 2022-12-12_20:27:04.310115) 20:27:05.574897 run osmo-msc_10.42.42.6(pid=24280): stderr: | 20221212202704634 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202704634 DLGLOBAL DEBUG validating counter group 0x7f1f17080c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202704635 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202704635 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202704635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202704635 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202704637 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202704637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202704637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202704637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:27:05.627009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Terminating (SIGTERM) 20:27:05.668820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Terminating (SIGTERM) 20:27:05.711269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24279): Terminating (SIGTERM) 20:27:05.753525 --- ParallelTerminationStrategy: PID 24273 died... 20:27:05.773539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Terminated: ok {rc=0} 20:27:05.820464 --- ParallelTerminationStrategy: PID 24276 died... 20:27:05.839982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Terminated: ok {rc=0} 20:27:05.886817 --- ParallelTerminationStrategy: PID 24279 died... 20:27:05.906338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24279): Terminated: ok {rc=0} 20:27:05.995343 bus /sierra_3: Setting Powered False 20:27:07.095539 bus /sierra_3: Setting Powered False 20:27:08.214924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 20:27:09.461748 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:27:09.467169 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 20:27:09.520296 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 20:27:09.546744 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 20:27:09.600413 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 20:27:09.655756 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 20:27:09.683058 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 20:27:10.228178 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 20:27:10.233355 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:27:10.244120 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 20:27:10.281050 tst handover.py: using LAC 31291 20:27:10.400814 tst handover.py: using RAC 181 20:27:10.529128 tst handover.py: using CellId 31291 20:27:10.658425 tst handover.py: using BVCI 31292 20:27:10.778779 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 20:27:10.829144 tst handover.py: using LAC 31292 20:27:10.958541 tst handover.py: using RAC 182 20:27:11.087904 tst handover.py: using CellId 31292 20:27:11.216231 tst handover.py: using BVCI 31293 20:27:11.334892 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:27:11.346345 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:27:11.357537 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:27:11.369322 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:27:11.381081 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:27:11.392702 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 20:27:11.509927 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 20:27:11.630071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:12.108488 run create_hlr_db(pid=24285): Launched 20:27:12.242502 bus /sierra_2: Setting Powered False 20:27:13.307128 run create_hlr_db(pid=24285): Terminated: ok {rc=0} 20:27:13.720215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24287): Launched 20:27:14.026471 run osmo-hlr_10.42.42.2(pid=24288): Launched 20:27:14.143063 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:14.657112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24290): Launched 20:27:14.961216 run osmo-stp_10.42.42.5(pid=24291): Launched 20:27:15.077533 run osmo-msc_10.42.42.6: Starting osmo-msc 20:27:15.602359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24293): Launched 20:27:15.936207 run osmo-msc_10.42.42.6(pid=24294): Launched 20:27:16.550813 run osmo-stp_10.42.42.5(pid=24291): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24291)] 20:27:16.746922 run osmo-stp_10.42.42.5(pid=24291): stdout: | (launched: 2022-12-12_20:27:14.904505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:16.890565 run osmo-stp_10.42.42.5(pid=24291): stderr: | 20221212202715074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202715074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202715074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202715075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202715075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202715075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202715075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:17.018556 run osmo-stp_10.42.42.5(pid=24291): stdout: | (launched: 2022-12-12_20:27:14.904505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:17.142043 run osmo-stp_10.42.42.5(pid=24291): stderr: | 20221212202715074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202715074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202715074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202715075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202715075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202715075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202715075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:17.289107 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24291): Process ended prematurely: osmo-stp_10.42.42.5(pid=24291) [trial-2381↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24291)] [trial-2381↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 20:27:17.298324 tst handover.py:18: Test FAILED (7.1 sec) 20:27:17.325624 run osmo-hlr_10.42.42.2(pid=24288): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24288)] 20:27:17.374549 run osmo-hlr_10.42.42.2(pid=24288): stdout: | (launched: 2022-12-12_20:27:13.969502) 20:27:17.424817 run osmo-hlr_10.42.42.2(pid=24288): stderr: | 20221212202714142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202714142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202714142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202714142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202714142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202714142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202714154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202714162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202714162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202714162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:17.494158 run osmo-msc_10.42.42.6(pid=24294): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24294)] 20:27:17.542409 run osmo-msc_10.42.42.6(pid=24294): stdout: | (launched: 2022-12-12_20:27:15.877037) 20:27:17.592390 run osmo-msc_10.42.42.6(pid=24294): stderr: | 20221212202716453 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202716453 DLGLOBAL DEBUG validating counter group 0x7f20eac5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202716453 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202716453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202716461 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202716461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202716463 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202716463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202716463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202716463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:27:17.642762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24287): Terminating (SIGTERM) 20:27:17.683186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24290): Terminating (SIGTERM) 20:27:17.723588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24293): Terminating (SIGTERM) 20:27:17.763906 --- ParallelTerminationStrategy: PID 24287 died... 20:27:17.783352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24287): Terminated: ok {rc=0} 20:27:17.828273 --- ParallelTerminationStrategy: PID 24290 died... 20:27:17.846856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24290): Terminated: ok {rc=0} 20:27:17.891539 --- ParallelTerminationStrategy: PID 24293 died... 20:27:17.910361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24293): Terminated: ok {rc=0} 20:27:17.996637 bus /sierra_3: Setting Powered False 20:27:19.096599 bus /sierra_3: Setting Powered False 20:27:20.211906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 20:27:21.474257 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:27:21.480850 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 20:27:21.532216 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:27:21.559638 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:27:21.614658 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 20:27:21.665051 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:27:21.692186 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:27:22.244649 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 20:27:22.250189 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:27:22.261806 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:27:22.300172 tst handover.py: using LAC 31293 20:27:22.426798 tst handover.py: using RAC 183 20:27:22.555735 tst handover.py: using CellId 31293 20:27:22.682217 tst handover.py: using BVCI 31294 20:27:22.801762 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:27:22.847664 tst handover.py: using LAC 31294 20:27:22.976030 tst handover.py: using RAC 184 20:27:23.104368 tst handover.py: using CellId 31294 20:27:23.230975 tst handover.py: using BVCI 31295 20:27:23.350523 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:27:23.362209 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:27:23.373656 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:27:23.385172 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:27:23.396573 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:27:23.408090 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:27:23.525364 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:27:23.641261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:24.088346 run create_hlr_db(pid=24299): Launched 20:27:24.206176 bus /sierra_2: Setting Powered False 20:27:25.267242 run create_hlr_db(pid=24299): Terminated: ok {rc=0} 20:27:25.686990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Launched 20:27:26.015711 run osmo-hlr_10.42.42.2(pid=24302): Launched 20:27:26.140166 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:26.675162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24304): Launched 20:27:27.002584 run osmo-stp_10.42.42.5(pid=24305): Launched 20:27:27.129791 run osmo-msc_10.42.42.6: Starting osmo-msc 20:27:27.698645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24307): Launched 20:27:28.026790 run osmo-msc_10.42.42.6(pid=24308): Launched 20:27:28.209054 run osmo-stp_10.42.42.5(pid=24305): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24305)] 20:27:28.346654 run osmo-stp_10.42.42.5(pid=24305): stdout: | (launched: 2022-12-12_20:27:26.941868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:28.485392 run osmo-stp_10.42.42.5(pid=24305): stderr: | 20221212202727131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202727131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202727131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202727131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202727132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202727132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202727132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:28.621909 run osmo-stp_10.42.42.5(pid=24305): stdout: | (launched: 2022-12-12_20:27:26.941868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:28.752673 run osmo-stp_10.42.42.5(pid=24305): stderr: | 20221212202727131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202727131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202727131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202727131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202727132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202727132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202727132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:28.908562 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24305): Process ended prematurely: osmo-stp_10.42.42.5(pid=24305) [trial-2381↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24305)] [trial-2381↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 20:27:28.917550 tst handover.py:18: Test FAILED (6.7 sec) 20:27:28.945179 run osmo-hlr_10.42.42.2(pid=24302): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24302)] 20:27:28.995028 run osmo-hlr_10.42.42.2(pid=24302): stdout: | (launched: 2022-12-12_20:27:25.955057) 20:27:29.046963 run osmo-hlr_10.42.42.2(pid=24302): stderr: | 20221212202726151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202726151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202726151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202726151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202726151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202726151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202726163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202726175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202726175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202726175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:29.119047 run osmo-msc_10.42.42.6(pid=24308): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24308)] 20:27:29.169157 run osmo-msc_10.42.42.6(pid=24308): stdout: | (launched: 2022-12-12_20:27:27.965362) 20:27:29.220874 run osmo-msc_10.42.42.6(pid=24308): stderr: | 20221212202728286 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202728286 DLGLOBAL DEBUG validating counter group 0x7f64b5f25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202728287 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202728287 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202728287 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202728287 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202728289 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202728289 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202728289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202728289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:27:29.273240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Terminating (SIGTERM) 20:27:29.314979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24304): Terminating (SIGTERM) 20:27:29.357151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24307): Terminating (SIGTERM) 20:27:29.399256 --- ParallelTerminationStrategy: PID 24301 died... 20:27:29.419342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Terminated: ok {rc=0} 20:27:29.466154 --- ParallelTerminationStrategy: PID 24304 died... 20:27:29.485911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24304): Terminated: ok {rc=0} 20:27:29.532031 --- ParallelTerminationStrategy: PID 24307 died... 20:27:29.551557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24307): Terminated: ok {rc=0} 20:27:29.639900 bus /sierra_3: Setting Powered False 20:27:30.740047 bus /sierra_3: Setting Powered False 20:27:31.879389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 20:27:33.151913 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:27:33.157212 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 20:27:33.211787 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:27:33.238529 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:27:33.291752 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 20:27:33.346309 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:27:33.372682 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:27:33.922458 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 20:27:33.927682 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:27:33.938689 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:27:33.977326 tst handover.py: using LAC 31295 20:27:34.116471 tst handover.py: using RAC 185 20:27:34.253412 tst handover.py: using CellId 31295 20:27:34.381218 tst handover.py: using BVCI 31296 20:27:34.500308 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:27:34.550281 tst handover.py: using LAC 31296 20:27:34.678125 tst handover.py: using RAC 186 20:27:34.804670 tst handover.py: using CellId 31296 20:27:34.937020 tst handover.py: using BVCI 31297 20:27:35.056107 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:27:35.067733 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:27:35.079083 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:27:35.090542 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:27:35.101880 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:27:35.113301 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:27:35.231162 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:27:35.348714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:35.797350 run create_hlr_db(pid=24313): Launched 20:27:35.916873 bus /sierra_2: Setting Powered False 20:27:36.977811 run create_hlr_db(pid=24313): Terminated: ok {rc=0} 20:27:37.379229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Launched 20:27:37.686712 run osmo-hlr_10.42.42.2(pid=24317): Launched 20:27:37.804144 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:38.307559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Launched 20:27:38.614599 run osmo-stp_10.42.42.5(pid=24320): Launched 20:27:38.731948 run osmo-msc_10.42.42.6: Starting osmo-msc 20:27:39.258561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24322): Launched 20:27:39.565630 run osmo-msc_10.42.42.6(pid=24323): Launched 20:27:39.739738 run osmo-stp_10.42.42.5(pid=24320): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] 20:27:39.868745 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-12_20:27:38.557068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:39.997302 run osmo-stp_10.42.42.5(pid=24320): stderr: | 20221212202738725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202738725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202738725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202738726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202738726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202738726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202738726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:40.123891 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-12_20:27:38.557068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:40.244907 run osmo-stp_10.42.42.5(pid=24320): stderr: | 20221212202738725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202738725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202738725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202738726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202738726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202738726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202738726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:40.390122 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2381↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] [trial-2381↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 20:27:40.398258 tst handover.py:18: Test FAILED (6.5 sec) 20:27:40.424785 run osmo-hlr_10.42.42.2(pid=24317): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24317)] 20:27:40.473586 run osmo-hlr_10.42.42.2(pid=24317): stdout: | (launched: 2022-12-12_20:27:37.629225) 20:27:40.523941 run osmo-hlr_10.42.42.2(pid=24317): stderr: | 20221212202737806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202737806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202737806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202737806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202737806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202737806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202737819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202737828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202737829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202737829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:40.594290 run osmo-msc_10.42.42.6(pid=24323): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24323)] 20:27:40.643001 run osmo-msc_10.42.42.6(pid=24323): stdout: | (launched: 2022-12-12_20:27:39.508121) 20:27:40.693401 run osmo-msc_10.42.42.6(pid=24323): stderr: | 20221212202739778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202739779 DLGLOBAL DEBUG validating counter group 0x7f9adc2f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202739779 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202739779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202739779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202739779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202739781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202739781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202739781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202739782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:27:40.744083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminating (SIGTERM) 20:27:40.784519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminating (SIGTERM) 20:27:40.825254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24322): Terminating (SIGTERM) 20:27:40.865836 --- ParallelTerminationStrategy: PID 24316 died... 20:27:40.885099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminated: ok {rc=0} 20:27:40.930445 --- ParallelTerminationStrategy: PID 24319 died... 20:27:40.949076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminated: ok {rc=0} 20:27:40.994733 --- ParallelTerminationStrategy: PID 24322 died... 20:27:41.013616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24322): Terminated: ok {rc=0} 20:27:41.100380 bus /sierra_3: Setting Powered False 20:27:42.200803 bus /sierra_3: Setting Powered False 20:27:43.317689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 20:27:44.580325 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:27:44.585371 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:27:44.627199 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:27:44.653918 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:27:44.707569 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:27:44.749887 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:27:44.776181 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:27:45.323806 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 20:27:45.328891 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:27:45.339754 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 20:27:45.377832 tst handover.py: using LAC 31297 20:27:45.497357 tst handover.py: using RAC 187 20:27:45.619039 tst handover.py: using CellId 31297 20:27:45.739556 tst handover.py: using BVCI 31298 20:27:45.854707 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 20:27:45.892266 tst handover.py: using LAC 31298 20:27:46.031474 tst handover.py: using RAC 188 20:27:46.154576 tst handover.py: using CellId 31298 20:27:46.275877 tst handover.py: using BVCI 31299 20:27:46.424745 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:27:46.437652 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:27:46.450048 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:27:46.463572 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:27:46.475733 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:27:46.488421 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 20:27:46.607114 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 20:27:46.721076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:47.213110 run create_hlr_db(pid=24328): Launched 20:27:47.370302 bus /sierra_2: Setting Powered False 20:27:48.431494 run create_hlr_db(pid=24328): Terminated: ok {rc=0} 20:27:48.848761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24330): Launched 20:27:49.177636 run osmo-hlr_10.42.42.2(pid=24331): Launched 20:27:49.301635 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:49.834832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24333): Launched 20:27:50.161137 run osmo-stp_10.42.42.5(pid=24334): Launched 20:27:50.285425 run osmo-msc_10.42.42.6: Starting osmo-msc 20:27:50.849065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24336): Launched 20:27:51.179088 run osmo-msc_10.42.42.6(pid=24337): Launched 20:27:51.363950 run osmo-stp_10.42.42.5(pid=24334): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24334)] 20:27:51.503847 run osmo-stp_10.42.42.5(pid=24334): stdout: | (launched: 2022-12-12_20:27:50.101040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:51.642408 run osmo-stp_10.42.42.5(pid=24334): stderr: | 20221212202750292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202750292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202750292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202750293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202750293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202750293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202750293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:51.778398 run osmo-stp_10.42.42.5(pid=24334): stdout: | (launched: 2022-12-12_20:27:50.101040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:51.911870 run osmo-stp_10.42.42.5(pid=24334): stderr: | 20221212202750292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202750292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202750292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202750293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202750293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202750293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202750293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:52.068822 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24334): Process ended prematurely: osmo-stp_10.42.42.5(pid=24334) [trial-2381↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24334)] [trial-2381↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 20:27:52.078021 tst handover.py:18: Test FAILED (6.7 sec) 20:27:52.105610 run osmo-hlr_10.42.42.2(pid=24331): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24331)] 20:27:52.155595 run osmo-hlr_10.42.42.2(pid=24331): stdout: | (launched: 2022-12-12_20:27:49.117187) 20:27:52.207534 run osmo-hlr_10.42.42.2(pid=24331): stderr: | 20221212202749315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202749315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202749315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202749315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202749315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202749315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202749327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202749335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202749335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202749336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:52.279873 run osmo-msc_10.42.42.6(pid=24337): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24337)] 20:27:52.329938 run osmo-msc_10.42.42.6(pid=24337): stdout: | (launched: 2022-12-12_20:27:51.117506) 20:27:52.381629 run osmo-msc_10.42.42.6(pid=24337): stderr: | 20221212202751438 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202751439 DLGLOBAL DEBUG validating counter group 0x7f700d3fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202751439 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202751439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202751439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202751439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202751441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202751441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202751441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202751441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:27:52.434249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24330): Terminating (SIGTERM) 20:27:52.476164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24333): Terminating (SIGTERM) 20:27:52.518170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24336): Terminating (SIGTERM) 20:27:52.560448 --- ParallelTerminationStrategy: PID 24330 died... 20:27:52.580817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24330): Terminated: ok {rc=0} 20:27:52.628214 --- ParallelTerminationStrategy: PID 24333 died... 20:27:52.648096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24333): Terminated: ok {rc=0} 20:27:52.694724 --- ParallelTerminationStrategy: PID 24336 died... 20:27:52.714614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24336): Terminated: ok {rc=0} 20:27:52.803141 bus /sierra_3: Setting Powered False 20:27:53.903823 bus /sierra_3: Setting Powered False 20:27:55.020616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 20:27:56.276758 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:27:56.282455 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:27:56.337685 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:27:56.365066 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:27:56.419749 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:27:56.474720 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:27:56.501869 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:27:57.053293 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 20:27:57.058676 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:27:57.070082 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:27:57.109252 tst handover.py: using LAC 31299 20:27:57.240093 tst handover.py: using RAC 189 20:27:57.367361 tst handover.py: using CellId 31299 20:27:57.493825 tst handover.py: using BVCI 31300 20:27:57.611443 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:27:57.660006 tst handover.py: using LAC 31300 20:27:57.785792 tst handover.py: using RAC 190 20:27:57.911962 tst handover.py: using CellId 31300 20:27:58.038455 tst handover.py: using BVCI 31301 20:27:58.158549 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:27:58.169976 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:27:58.181311 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:27:58.192527 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:27:58.203870 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:27:58.215109 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:27:58.330230 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:27:58.448764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:58.926891 run create_hlr_db(pid=24342): Launched 20:27:59.059509 bus /sierra_2: Setting Powered False 20:28:00.124418 run create_hlr_db(pid=24342): Terminated: ok {rc=0} 20:28:00.536472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24344): Launched 20:28:00.851214 run osmo-hlr_10.42.42.2(pid=24345): Launched 20:28:01.077988 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:01.784534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24347): Launched 20:28:02.106298 run osmo-stp_10.42.42.5(pid=24348): Launched 20:28:02.402236 run osmo-msc_10.42.42.6: Starting osmo-msc 20:28:02.929205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24350): Launched 20:28:03.235993 run osmo-msc_10.42.42.6(pid=24351): Launched 20:28:03.407484 run osmo-stp_10.42.42.5(pid=24348): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24348)] 20:28:03.536360 run osmo-stp_10.42.42.5(pid=24348): stdout: | (launched: 2022-12-12_20:28:02.047638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:03.665349 run osmo-stp_10.42.42.5(pid=24348): stderr: | 20221212202802277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202802279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202802280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202802281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202802283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202802283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202802283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:03.792692 run osmo-stp_10.42.42.5(pid=24348): stdout: | (launched: 2022-12-12_20:28:02.047638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:03.914356 run osmo-stp_10.42.42.5(pid=24348): stderr: | 20221212202802277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202802279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202802280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202802281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202802283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202802283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202802283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:04.059891 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24348): Process ended prematurely: osmo-stp_10.42.42.5(pid=24348) [trial-2381↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24348)] [trial-2381↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 20:28:04.068475 tst handover.py:18: Test FAILED (7.0 sec) 20:28:04.095032 run osmo-hlr_10.42.42.2(pid=24345): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24345)] 20:28:04.143264 run osmo-hlr_10.42.42.2(pid=24345): stdout: | (launched: 2022-12-12_20:28:00.787622) 20:28:04.193093 run osmo-hlr_10.42.42.2(pid=24345): stderr: | 20221212202801115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202801115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202801115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202801115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202801115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202801115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202801133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202801152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202801152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202801152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:04.262049 run osmo-msc_10.42.42.6(pid=24351): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24351)] 20:28:04.309933 run osmo-msc_10.42.42.6(pid=24351): stdout: | (launched: 2022-12-12_20:28:03.178935) 20:28:04.359270 run osmo-msc_10.42.42.6(pid=24351): stderr: | 20221212202803449 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202803449 DLGLOBAL DEBUG validating counter group 0x7fa06d149c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202803450 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202803450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202803450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202803450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202803452 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202803452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202803452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202803452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:28:04.409304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24344): Terminating (SIGTERM) 20:28:04.449205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24347): Terminating (SIGTERM) 20:28:04.489433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24350): Terminating (SIGTERM) 20:28:04.529885 --- ParallelTerminationStrategy: PID 24344 died... 20:28:04.549112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24344): Terminated: ok {rc=0} 20:28:04.594210 --- ParallelTerminationStrategy: PID 24347 died... 20:28:04.612646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24347): Terminated: ok {rc=0} 20:28:04.656916 --- ParallelTerminationStrategy: PID 24350 died... 20:28:04.676170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24350): Terminated: ok {rc=0} 20:28:04.760224 bus /sierra_3: Setting Powered False 20:28:05.859713 bus /sierra_3: Setting Powered False 20:28:06.977754 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 20:28:08.243044 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:28:08.248852 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:28:08.303636 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:28:08.331514 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:28:08.385633 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:28:08.440713 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:28:08.468652 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:28:09.019310 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 20:28:09.024747 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:28:09.036300 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:28:09.075341 tst handover.py: using LAC 31301 20:28:09.203338 tst handover.py: using RAC 191 20:28:09.333070 tst handover.py: using CellId 31301 20:28:09.461440 tst handover.py: using BVCI 31302 20:28:09.574787 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:28:09.622956 tst handover.py: using LAC 31302 20:28:09.743619 tst handover.py: using RAC 192 20:28:09.863659 tst handover.py: using CellId 31302 20:28:09.993263 tst handover.py: using BVCI 31303 20:28:10.113690 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:28:10.125332 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:28:10.136621 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:28:10.148097 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:28:10.159469 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:28:10.170852 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:28:10.287266 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:28:10.408690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:10.889415 run create_hlr_db(pid=24356): Launched 20:28:11.023489 bus /sierra_2: Setting Powered False 20:28:12.087224 run create_hlr_db(pid=24356): Terminated: ok {rc=0} 20:28:12.498732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24358): Launched 20:28:12.808629 run osmo-hlr_10.42.42.2(pid=24359): Launched 20:28:12.925985 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:13.441856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24361): Launched 20:28:13.748401 run osmo-stp_10.42.42.5(pid=24362): Launched 20:28:13.865661 run osmo-msc_10.42.42.6: Starting osmo-msc 20:28:14.394693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24364): Launched 20:28:14.704549 run osmo-msc_10.42.42.6(pid=24365): Launched 20:28:14.876464 run osmo-stp_10.42.42.5(pid=24362): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24362)] 20:28:15.006523 run osmo-stp_10.42.42.5(pid=24362): stdout: | (launched: 2022-12-12_20:28:13.690993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:15.136552 run osmo-stp_10.42.42.5(pid=24362): stderr: | 20221212202813862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202813862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202813862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202813863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202813863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202813863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202813863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:15.264083 run osmo-stp_10.42.42.5(pid=24362): stdout: | (launched: 2022-12-12_20:28:13.690993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:15.386093 run osmo-stp_10.42.42.5(pid=24362): stderr: | 20221212202813862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202813862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202813862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202813863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202813863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202813863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202813863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:15.532304 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24362): Process ended prematurely: osmo-stp_10.42.42.5(pid=24362) [trial-2381↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24362)] [trial-2381↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 20:28:15.540593 tst handover.py:18: Test FAILED (6.5 sec) 20:28:15.567325 run osmo-hlr_10.42.42.2(pid=24359): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24359)] 20:28:15.615953 run osmo-hlr_10.42.42.2(pid=24359): stdout: | (launched: 2022-12-12_20:28:12.751721) 20:28:15.666353 run osmo-hlr_10.42.42.2(pid=24359): stderr: | 20221212202812926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202812926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202812926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202812926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202812926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202812926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202812938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202812946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202812946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202812946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:15.736527 run osmo-msc_10.42.42.6(pid=24365): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24365)] 20:28:15.784727 run osmo-msc_10.42.42.6(pid=24365): stdout: | (launched: 2022-12-12_20:28:14.647408) 20:28:15.834941 run osmo-msc_10.42.42.6(pid=24365): stderr: | 20221212202814917 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202814917 DLGLOBAL DEBUG validating counter group 0x7fddb2618c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202814917 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202814918 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202814918 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202814918 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202814919 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202814920 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202814920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202814920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:28:15.888751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24358): Terminating (SIGTERM) 20:28:15.939457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24361): Terminating (SIGTERM) 20:28:15.981722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24364): Terminating (SIGTERM) 20:28:16.024875 --- ParallelTerminationStrategy: PID 24358 died... 20:28:16.045879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24358): Terminated: ok {rc=0} 20:28:16.094268 --- ParallelTerminationStrategy: PID 24361 died... 20:28:16.114448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24361): Terminated: ok {rc=0} 20:28:16.162685 --- ParallelTerminationStrategy: PID 24364 died... 20:28:16.182735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24364): Terminated: ok {rc=0} 20:28:16.271952 bus /sierra_3: Setting Powered False 20:28:17.370299 bus /sierra_3: Setting Powered False 20:28:18.484568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 20:28:19.749089 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:28:19.754793 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 20:28:19.792771 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 20:28:19.820327 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 20:28:19.875332 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 20:28:19.913438 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 20:28:19.940764 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 20:28:20.490808 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 20:28:20.496219 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:28:20.507705 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 20:28:20.542901 tst handover.py: using LAC 31303 20:28:20.663495 tst handover.py: using RAC 193 20:28:20.791918 tst handover.py: using CellId 31303 20:28:20.921567 tst handover.py: using BVCI 31304 20:28:21.035747 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 20:28:21.069862 tst handover.py: using LAC 31304 20:28:21.199156 tst handover.py: using RAC 194 20:28:21.326973 tst handover.py: using CellId 31304 20:28:21.458813 tst handover.py: using BVCI 31305 20:28:21.578674 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:28:21.590531 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:28:21.601740 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:28:21.612798 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:28:21.623943 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 20:28:21.635214 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 20:28:21.751384 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 20:28:21.869589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:22.317256 run create_hlr_db(pid=24370): Launched 20:28:22.434908 bus /sierra_2: Setting Powered False 20:28:23.496016 run create_hlr_db(pid=24370): Terminated: ok {rc=0} 20:28:23.916567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24372): Launched 20:28:24.247875 run osmo-hlr_10.42.42.2(pid=24373): Launched 20:28:24.375536 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:24.913721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24375): Launched 20:28:25.245375 run osmo-stp_10.42.42.5(pid=24376): Launched 20:28:25.371487 run osmo-msc_10.42.42.6: Starting osmo-msc 20:28:25.938078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24378): Launched 20:28:26.267033 run osmo-msc_10.42.42.6(pid=24379): Launched 20:28:26.452290 run osmo-stp_10.42.42.5(pid=24376): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24376)] 20:28:26.591520 run osmo-stp_10.42.42.5(pid=24376): stdout: | (launched: 2022-12-12_20:28:25.183849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:26.729915 run osmo-stp_10.42.42.5(pid=24376): stderr: | 20221212202825376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202825376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202825376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202825377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202825377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202825377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202825377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:26.866901 run osmo-stp_10.42.42.5(pid=24376): stdout: | (launched: 2022-12-12_20:28:25.183849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:26.997536 run osmo-stp_10.42.42.5(pid=24376): stderr: | 20221212202825376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202825376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202825376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202825377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202825377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202825377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202825377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:27.153847 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24376): Process ended prematurely: osmo-stp_10.42.42.5(pid=24376) [trial-2381↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24376)] [trial-2381↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 20:28:27.162900 tst handover.py:18: Test FAILED (6.7 sec) 20:28:27.191004 run osmo-hlr_10.42.42.2(pid=24373): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24373)] 20:28:27.241637 run osmo-hlr_10.42.42.2(pid=24373): stdout: | (launched: 2022-12-12_20:28:24.187446) 20:28:27.293552 run osmo-hlr_10.42.42.2(pid=24373): stderr: | 20221212202824385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202824385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202824385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202824385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202824385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202824385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202824398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202824406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202824407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202824407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:27.367985 run osmo-msc_10.42.42.6(pid=24379): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24379)] 20:28:27.417789 run osmo-msc_10.42.42.6(pid=24379): stdout: | (launched: 2022-12-12_20:28:26.206000) 20:28:27.469681 run osmo-msc_10.42.42.6(pid=24379): stderr: | 20221212202826527 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202826527 DLGLOBAL DEBUG validating counter group 0x7fbd4de9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202826528 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202826528 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202826528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202826528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202826530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202826530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202826530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202826530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:28:27.521603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24372): Terminating (SIGTERM) 20:28:27.563163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24375): Terminating (SIGTERM) 20:28:27.604863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24378): Terminating (SIGTERM) 20:28:27.647026 --- ParallelTerminationStrategy: PID 24372 died... 20:28:27.667388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24372): Terminated: ok {rc=0} 20:28:27.714143 --- ParallelTerminationStrategy: PID 24375 died... 20:28:27.733976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24375): Terminated: ok {rc=0} 20:28:27.780231 --- ParallelTerminationStrategy: PID 24378 died... 20:28:27.800013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24378): Terminated: ok {rc=0} 20:28:27.888039 bus /sierra_3: Setting Powered False 20:28:28.988411 bus /sierra_3: Setting Powered False 20:28:30.106953 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 20:28:31.347713 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:28:31.353546 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 20:28:31.406517 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 20:28:31.434615 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 20:28:31.488153 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 20:28:31.551361 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 20:28:31.588860 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 20:28:32.119825 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 20:28:32.125878 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:28:32.139701 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 20:28:32.184733 tst handover.py: using LAC 31305 20:28:32.306907 tst handover.py: using RAC 195 20:28:32.429423 tst handover.py: using CellId 31305 20:28:32.559894 tst handover.py: using BVCI 31306 20:28:32.680456 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 20:28:32.729994 tst handover.py: using LAC 31306 20:28:32.859030 tst handover.py: using RAC 196 20:28:32.988047 tst handover.py: using CellId 31306 20:28:33.115460 tst handover.py: using BVCI 31307 20:28:33.235703 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:28:33.247686 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:28:33.259065 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:28:33.270403 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:28:33.281836 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:28:33.293237 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 20:28:33.409526 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 20:28:33.524764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:34.007273 run create_hlr_db(pid=24384): Launched 20:28:34.140916 bus /sierra_2: Setting Powered False 20:28:35.205892 run create_hlr_db(pid=24384): Terminated: ok {rc=0} 20:28:35.619116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Launched 20:28:35.927588 run osmo-hlr_10.42.42.2(pid=24387): Launched 20:28:36.045248 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:36.563069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Launched 20:28:36.871270 run osmo-stp_10.42.42.5(pid=24390): Launched 20:28:36.988262 run osmo-msc_10.42.42.6: Starting osmo-msc 20:28:37.517249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24392): Launched 20:28:37.823928 run osmo-msc_10.42.42.6(pid=24393): Launched 20:28:37.996323 run osmo-stp_10.42.42.5(pid=24390): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] 20:28:38.127299 run osmo-stp_10.42.42.5(pid=24390): stdout: | (launched: 2022-12-12_20:28:36.813545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:38.256913 run osmo-stp_10.42.42.5(pid=24390): stderr: | 20221212202836983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202836983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202836984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202836984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202836985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202836985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202836985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:38.384390 run osmo-stp_10.42.42.5(pid=24390): stdout: | (launched: 2022-12-12_20:28:36.813545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:38.505944 run osmo-stp_10.42.42.5(pid=24390): stderr: | 20221212202836983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202836983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202836984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202836984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202836985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202836985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202836985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:38.651806 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24390): Process ended prematurely: osmo-stp_10.42.42.5(pid=24390) [trial-2381↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] [trial-2381↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 20:28:38.660292 tst handover.py:18: Test FAILED (6.5 sec) 20:28:38.686844 run osmo-hlr_10.42.42.2(pid=24387): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24387)] 20:28:38.735535 run osmo-hlr_10.42.42.2(pid=24387): stdout: | (launched: 2022-12-12_20:28:35.870846) 20:28:38.785587 run osmo-hlr_10.42.42.2(pid=24387): stderr: | 20221212202836046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202836046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202836046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202836046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202836046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202836046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202836057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202836066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202836066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202836066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:38.855486 run osmo-msc_10.42.42.6(pid=24393): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24393)] 20:28:38.904184 run osmo-msc_10.42.42.6(pid=24393): stdout: | (launched: 2022-12-12_20:28:37.766930) 20:28:38.954182 run osmo-msc_10.42.42.6(pid=24393): stderr: | 20221212202838034 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202838034 DLGLOBAL DEBUG validating counter group 0x7f39fc747c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202838034 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202838034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202838034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202838034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202838036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202838037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202838037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202838037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:28:39.004665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Terminating (SIGTERM) 20:28:39.044739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Terminating (SIGTERM) 20:28:39.085060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24392): Terminating (SIGTERM) 20:28:39.125720 --- ParallelTerminationStrategy: PID 24386 died... 20:28:39.144753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Terminated: ok {rc=0} 20:28:39.189964 --- ParallelTerminationStrategy: PID 24389 died... 20:28:39.208483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Terminated: ok {rc=0} 20:28:39.252936 --- ParallelTerminationStrategy: PID 24392 died... 20:28:39.271766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24392): Terminated: ok {rc=0} 20:28:39.359530 bus /sierra_3: Setting Powered False 20:28:40.461379 bus /sierra_3: Setting Powered False 20:28:41.577450 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 20:28:42.836538 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:28:42.842445 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 20:28:42.890252 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:28:42.917716 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:28:42.970607 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 20:28:43.018651 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:28:43.046309 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:28:43.600179 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 20:28:43.606071 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:28:43.617724 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:28:43.655638 tst handover.py: using LAC 31307 20:28:43.784430 tst handover.py: using RAC 197 20:28:43.910658 tst handover.py: using CellId 31307 20:28:44.036821 tst handover.py: using BVCI 31308 20:28:44.155502 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:28:44.199957 tst handover.py: using LAC 31308 20:28:44.320037 tst handover.py: using RAC 198 20:28:44.437612 tst handover.py: using CellId 31308 20:28:44.565846 tst handover.py: using BVCI 31309 20:28:44.679671 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:28:44.690736 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:28:44.701599 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:28:44.712830 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:28:44.724101 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:28:44.735619 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:28:44.854063 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:28:44.973551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:45.453509 run create_hlr_db(pid=24398): Launched 20:28:45.588123 bus /sierra_2: Setting Powered False 20:28:46.648782 run create_hlr_db(pid=24398): Terminated: ok {rc=0} 20:28:47.069671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24400): Launched 20:28:47.393323 run osmo-hlr_10.42.42.2(pid=24401): Launched 20:28:47.512273 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:48.027008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24403): Launched 20:28:48.335247 run osmo-stp_10.42.42.5(pid=24404): Launched 20:28:48.454649 run osmo-msc_10.42.42.6: Starting osmo-msc 20:28:48.982370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24406): Launched 20:28:49.290779 run osmo-msc_10.42.42.6(pid=24407): Launched 20:28:49.462812 run osmo-stp_10.42.42.5(pid=24404): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24404)] 20:28:49.603256 run osmo-stp_10.42.42.5(pid=24404): stdout: | (launched: 2022-12-12_20:28:48.278340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:49.733241 run osmo-stp_10.42.42.5(pid=24404): stderr: | 20221212202848447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202848448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202848448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202848448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202848449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202848449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202848449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:49.860657 run osmo-stp_10.42.42.5(pid=24404): stdout: | (launched: 2022-12-12_20:28:48.278340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:49.983165 run osmo-stp_10.42.42.5(pid=24404): stderr: | 20221212202848447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202848448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202848448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202848448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202848449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202848449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202848449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:50.129201 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24404): Process ended prematurely: osmo-stp_10.42.42.5(pid=24404) [trial-2381↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24404)] [trial-2381↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 20:28:50.137690 tst handover.py:18: Test FAILED (6.5 sec) 20:28:50.164649 run osmo-hlr_10.42.42.2(pid=24401): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24401)] 20:28:50.213038 run osmo-hlr_10.42.42.2(pid=24401): stdout: | (launched: 2022-12-12_20:28:47.335896) 20:28:50.262882 run osmo-hlr_10.42.42.2(pid=24401): stderr: | 20221212202847512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202847512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202847512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202847512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202847512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202847512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202847523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202847531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202847532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202847532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:50.332488 run osmo-msc_10.42.42.6(pid=24407): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24407)] 20:28:50.380860 run osmo-msc_10.42.42.6(pid=24407): stdout: | (launched: 2022-12-12_20:28:49.232695) 20:28:50.430781 run osmo-msc_10.42.42.6(pid=24407): stderr: | 20221212202849504 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202849505 DLGLOBAL DEBUG validating counter group 0x7fa31b954c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202849505 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202849505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202849505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202849505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202849507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202849507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202849507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202849507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:28:50.481210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24400): Terminating (SIGTERM) 20:28:50.521793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24403): Terminating (SIGTERM) 20:28:50.562323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24406): Terminating (SIGTERM) 20:28:50.602825 --- ParallelTerminationStrategy: PID 24400 died... 20:28:50.622071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24400): Terminated: ok {rc=0} 20:28:50.667086 --- ParallelTerminationStrategy: PID 24403 died... 20:28:50.685929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24403): Terminated: ok {rc=0} 20:28:50.730733 --- ParallelTerminationStrategy: PID 24406 died... 20:28:50.749473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24406): Terminated: ok {rc=0} 20:28:50.835783 bus /sierra_3: Setting Powered False 20:28:51.935981 bus /sierra_3: Setting Powered False 20:28:53.048147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 20:28:54.302724 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:28:54.307825 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 20:28:54.358989 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:28:54.385297 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:28:54.437452 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 20:28:54.487837 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:28:54.513932 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:28:55.070140 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 20:28:55.075833 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:28:55.088560 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:28:55.122577 tst handover.py: using LAC 31309 20:28:55.240136 tst handover.py: using RAC 199 20:28:55.359032 tst handover.py: using CellId 31309 20:28:55.477039 tst handover.py: using BVCI 31310 20:28:55.587285 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:28:55.634688 tst handover.py: using LAC 31310 20:28:55.751759 tst handover.py: using RAC 200 20:28:55.872342 tst handover.py: using CellId 31310 20:28:55.990897 tst handover.py: using BVCI 31311 20:28:56.100838 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:28:56.111951 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:28:56.122780 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:28:56.133877 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:28:56.145091 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:28:56.156056 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:28:56.275426 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:28:56.391184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:56.839520 run create_hlr_db(pid=24412): Launched 20:28:56.973313 bus /sierra_2: Setting Powered False 20:28:58.038538 run create_hlr_db(pid=24412): Terminated: ok {rc=0} 20:28:58.449266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Launched 20:28:58.755883 run osmo-hlr_10.42.42.2(pid=24415): Launched 20:28:58.872371 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:59.375547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Launched 20:28:59.682224 run osmo-stp_10.42.42.5(pid=24418): Launched 20:28:59.799619 run osmo-msc_10.42.42.6: Starting osmo-msc 20:29:00.327662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24420): Launched 20:29:00.634751 run osmo-msc_10.42.42.6(pid=24421): Launched 20:29:00.806279 run osmo-stp_10.42.42.5(pid=24418): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] 20:29:01.008306 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-12_20:28:59.624882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:01.333890 run osmo-stp_10.42.42.5(pid=24418): stderr: | 20221212202859794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202859794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202859795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202859795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202859795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202859796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202859796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:01.466370 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-12_20:28:59.624882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:01.590818 run osmo-stp_10.42.42.5(pid=24418): stderr: | 20221212202859794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202859794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202859795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202859795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202859795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202859796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202859796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:01.738867 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2381↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] [trial-2381↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 20:29:01.747162 tst handover.py:18: Test FAILED (6.7 sec) 20:29:01.775849 run osmo-hlr_10.42.42.2(pid=24415): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24415)] 20:29:01.826010 run osmo-hlr_10.42.42.2(pid=24415): stdout: | (launched: 2022-12-12_20:28:58.699039) 20:29:01.878220 run osmo-hlr_10.42.42.2(pid=24415): stderr: | 20221212202858877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202858877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202858877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202858877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202858877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202858877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202858890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202858899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202858899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202858899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:01.949819 run osmo-msc_10.42.42.6(pid=24421): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24421)] 20:29:02.000494 run osmo-msc_10.42.42.6(pid=24421): stdout: | (launched: 2022-12-12_20:29:00.577729) 20:29:02.052629 run osmo-msc_10.42.42.6(pid=24421): stderr: | 20221212202900885 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202900885 DLGLOBAL DEBUG validating counter group 0x7fb15e8bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202900885 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202900885 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202900886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202900886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202900887 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202900888 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202900888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202900888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:29:02.108717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminating (SIGTERM) 20:29:02.164623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminating (SIGTERM) 20:29:02.225168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24420): Terminating (SIGTERM) 20:29:02.276113 --- ParallelTerminationStrategy: PID 24414 died... 20:29:02.297101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminated: ok {rc=0} 20:29:02.347106 --- ParallelTerminationStrategy: PID 24417 died... 20:29:02.367667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminated: ok {rc=0} 20:29:02.415037 --- ParallelTerminationStrategy: PID 24420 died... 20:29:02.435066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24420): Terminated: ok {rc=0} 20:29:02.524996 bus /sierra_3: Setting Powered False 20:29:03.624661 bus /sierra_3: Setting Powered False 20:29:04.742466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 20:29:06.003372 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:29:06.009024 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:29:06.049227 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:29:06.076715 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:29:06.131330 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:29:06.170430 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:29:06.197733 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:29:06.750925 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 20:29:06.756331 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:29:06.767563 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 20:29:06.802949 tst handover.py: using LAC 31311 20:29:06.928764 tst handover.py: using RAC 201 20:29:07.054221 tst handover.py: using CellId 31311 20:29:07.179803 tst handover.py: using BVCI 31312 20:29:07.298159 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 20:29:07.332557 tst handover.py: using LAC 31312 20:29:07.458503 tst handover.py: using RAC 202 20:29:07.588000 tst handover.py: using CellId 31312 20:29:07.719560 tst handover.py: using BVCI 31313 20:29:07.832752 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:29:07.843739 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:29:07.854640 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:29:07.866081 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:29:07.877352 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:29:07.888504 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 20:29:08.008407 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 20:29:08.123829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:08.572463 run create_hlr_db(pid=24426): Launched 20:29:08.690208 bus /sierra_2: Setting Powered False 20:29:09.751286 run create_hlr_db(pid=24426): Terminated: ok {rc=0} 20:29:10.172659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24428): Launched 20:29:10.503044 run osmo-hlr_10.42.42.2(pid=24429): Launched 20:29:10.630162 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:11.169275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24431): Launched 20:29:11.496902 run osmo-stp_10.42.42.5(pid=24432): Launched 20:29:11.623223 run osmo-msc_10.42.42.6: Starting osmo-msc 20:29:12.188406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24434): Launched 20:29:12.517649 run osmo-msc_10.42.42.6(pid=24435): Launched 20:29:12.701217 run osmo-stp_10.42.42.5(pid=24432): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24432)] 20:29:12.838320 run osmo-stp_10.42.42.5(pid=24432): stdout: | (launched: 2022-12-12_20:29:11.436020) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:12.975739 run osmo-stp_10.42.42.5(pid=24432): stderr: | 20221212202911629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202911629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202911630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202911630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202911630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202911630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202911631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:13.112717 run osmo-stp_10.42.42.5(pid=24432): stdout: | (launched: 2022-12-12_20:29:11.436020) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:13.242977 run osmo-stp_10.42.42.5(pid=24432): stderr: | 20221212202911629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202911629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202911630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202911630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202911630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202911630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202911631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:13.398999 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24432): Process ended prematurely: osmo-stp_10.42.42.5(pid=24432) [trial-2381↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24432)] [trial-2381↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 20:29:13.407850 tst handover.py:18: Test FAILED (6.6 sec) 20:29:13.435806 run osmo-hlr_10.42.42.2(pid=24429): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24429)] 20:29:13.486921 run osmo-hlr_10.42.42.2(pid=24429): stdout: | (launched: 2022-12-12_20:29:10.441995) 20:29:13.539503 run osmo-hlr_10.42.42.2(pid=24429): stderr: | 20221212202910641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202910641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202910642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202910642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202910642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202910642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202910654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202910665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202910665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202910665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:13.613363 run osmo-msc_10.42.42.6(pid=24435): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24435)] 20:29:13.664019 run osmo-msc_10.42.42.6(pid=24435): stdout: | (launched: 2022-12-12_20:29:12.456124) 20:29:13.716701 run osmo-msc_10.42.42.6(pid=24435): stderr: | 20221212202912781 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202912782 DLGLOBAL DEBUG validating counter group 0x7f9272c31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202912782 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202912782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202912782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202912782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202912784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202912784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202912784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202912784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:29:13.769275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24428): Terminating (SIGTERM) 20:29:13.811290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24431): Terminating (SIGTERM) 20:29:13.853592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24434): Terminating (SIGTERM) 20:29:13.896002 --- ParallelTerminationStrategy: PID 24428 died... 20:29:13.915957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24428): Terminated: ok {rc=0} 20:29:13.962660 --- ParallelTerminationStrategy: PID 24431 died... 20:29:13.982371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24431): Terminated: ok {rc=0} 20:29:14.028765 --- ParallelTerminationStrategy: PID 24434 died... 20:29:14.048499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24434): Terminated: ok {rc=0} 20:29:14.137696 bus /sierra_3: Setting Powered False 20:29:15.238828 bus /sierra_3: Setting Powered False 20:29:16.357209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 20:29:17.606154 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:29:17.611844 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:29:17.663841 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:29:17.691399 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:29:17.747942 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:29:17.799400 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:29:17.826002 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:29:18.380108 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 20:29:18.386091 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:29:18.397589 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:29:18.433648 tst handover.py: using LAC 31313 20:29:18.563956 tst handover.py: using RAC 203 20:29:18.692174 tst handover.py: using CellId 31313 20:29:18.818654 tst handover.py: using BVCI 31314 20:29:18.936776 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:29:18.985395 tst handover.py: using LAC 31314 20:29:19.114100 tst handover.py: using RAC 204 20:29:19.244670 tst handover.py: using CellId 31314 20:29:19.373278 tst handover.py: using BVCI 31315 20:29:19.491837 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:29:19.503258 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:29:19.514399 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:29:19.525639 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:29:19.536916 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:29:19.548059 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:29:19.663464 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:29:19.779154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:20.227528 run create_hlr_db(pid=24442): Launched 20:29:20.346885 bus /sierra_2: Setting Powered False 20:29:21.408120 run create_hlr_db(pid=24442): Terminated: ok {rc=0} 20:29:21.828380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24444): Launched 20:29:22.157178 run osmo-hlr_10.42.42.2(pid=24445): Launched 20:29:22.283044 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:22.822058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24447): Launched 20:29:23.149638 run osmo-stp_10.42.42.5(pid=24448): Launched 20:29:23.273629 run osmo-msc_10.42.42.6: Starting osmo-msc 20:29:23.838300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24450): Launched 20:29:24.165736 run osmo-msc_10.42.42.6(pid=24451): Launched 20:29:24.349743 run osmo-stp_10.42.42.5(pid=24448): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24448)] 20:29:24.487053 run osmo-stp_10.42.42.5(pid=24448): stdout: | (launched: 2022-12-12_20:29:23.088389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:24.624253 run osmo-stp_10.42.42.5(pid=24448): stderr: | 20221212202923281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202923282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202923282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202923282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202923283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202923283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202923283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:24.760473 run osmo-stp_10.42.42.5(pid=24448): stdout: | (launched: 2022-12-12_20:29:23.088389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:24.890378 run osmo-stp_10.42.42.5(pid=24448): stderr: | 20221212202923281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202923282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202923282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202923282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202923283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202923283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202923283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:25.045731 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24448): Process ended prematurely: osmo-stp_10.42.42.5(pid=24448) [trial-2381↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24448)] [trial-2381↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 20:29:25.054628 tst handover.py:18: Test FAILED (6.7 sec) 20:29:25.082144 run osmo-hlr_10.42.42.2(pid=24445): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24445)] 20:29:25.132385 run osmo-hlr_10.42.42.2(pid=24445): stdout: | (launched: 2022-12-12_20:29:22.097563) 20:29:25.184526 run osmo-hlr_10.42.42.2(pid=24445): stderr: | 20221212202922295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202922295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202922295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202922295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202922295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202922295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202922308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202922318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202922318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202922319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:25.257108 run osmo-msc_10.42.42.6(pid=24451): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24451)] 20:29:25.307183 run osmo-msc_10.42.42.6(pid=24451): stdout: | (launched: 2022-12-12_20:29:24.105111) 20:29:25.359052 run osmo-msc_10.42.42.6(pid=24451): stderr: | 20221212202924429 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202924429 DLGLOBAL DEBUG validating counter group 0x7f24f3716c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202924429 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202924429 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202924430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202924430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202924431 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202924432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202924432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202924432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:29:25.411007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24444): Terminating (SIGTERM) 20:29:25.452744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24447): Terminating (SIGTERM) 20:29:25.494857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24450): Terminating (SIGTERM) 20:29:25.537154 --- ParallelTerminationStrategy: PID 24444 died... 20:29:25.557229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24444): Terminated: ok {rc=0} 20:29:25.603716 --- ParallelTerminationStrategy: PID 24447 died... 20:29:25.623730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24447): Terminated: ok {rc=0} 20:29:25.670679 --- ParallelTerminationStrategy: PID 24450 died... 20:29:25.690399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24450): Terminated: ok {rc=0} 20:29:25.777698 bus /sierra_3: Setting Powered False 20:29:26.875543 bus /sierra_3: Setting Powered False 20:29:27.993228 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 20:29:29.255615 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:29:29.261281 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:29:29.311967 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:29:29.339344 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:29:29.392793 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:29:29.443405 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:29:29.470517 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:29:30.022352 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 20:29:30.027744 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:29:30.039036 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:29:30.074670 tst handover.py: using LAC 31315 20:29:30.203883 tst handover.py: using RAC 205 20:29:30.326045 tst handover.py: using CellId 31315 20:29:30.445678 tst handover.py: using BVCI 31316 20:29:30.567164 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:29:30.616098 tst handover.py: using LAC 31316 20:29:30.736102 tst handover.py: using RAC 206 20:29:30.859322 tst handover.py: using CellId 31316 20:29:30.985460 tst handover.py: using BVCI 31317 20:29:31.099220 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:29:31.111316 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:29:31.123171 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:29:31.136332 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:29:31.149425 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:29:31.162482 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:29:31.285382 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:29:31.429502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:31.969200 run create_hlr_db(pid=24457): Launched 20:29:32.102937 bus /sierra_2: Setting Powered False 20:29:33.163718 run create_hlr_db(pid=24457): Terminated: ok {rc=0} 20:29:33.584507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24459): Launched 20:29:33.915398 run osmo-hlr_10.42.42.2(pid=24460): Launched 20:29:34.042415 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:34.582364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24465): Launched 20:29:34.911959 run osmo-stp_10.42.42.5(pid=24466): Launched 20:29:35.038592 run osmo-msc_10.42.42.6: Starting osmo-msc 20:29:35.603932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24468): Launched 20:29:35.935004 run osmo-msc_10.42.42.6(pid=24469): Launched 20:29:36.119462 run osmo-stp_10.42.42.5(pid=24466): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24466)] 20:29:36.256844 run osmo-stp_10.42.42.5(pid=24466): stdout: | (launched: 2022-12-12_20:29:34.851502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:36.394797 run osmo-stp_10.42.42.5(pid=24466): stderr: | 20221212202935043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202935043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202935044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202935044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202935044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202935045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202935045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:36.531596 run osmo-stp_10.42.42.5(pid=24466): stdout: | (launched: 2022-12-12_20:29:34.851502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:36.661621 run osmo-stp_10.42.42.5(pid=24466): stderr: | 20221212202935043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202935043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202935044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202935044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202935044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202935045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202935045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:36.817352 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24466): Process ended prematurely: osmo-stp_10.42.42.5(pid=24466) [trial-2381↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24466)] [trial-2381↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 20:29:36.826195 tst handover.py:18: Test FAILED (6.8 sec) 20:29:36.853729 run osmo-hlr_10.42.42.2(pid=24460): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24460)] 20:29:36.903725 run osmo-hlr_10.42.42.2(pid=24460): stdout: | (launched: 2022-12-12_20:29:33.854901) 20:29:36.955425 run osmo-hlr_10.42.42.2(pid=24460): stderr: | 20221212202934054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202934054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202934054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202934054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202934054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202934054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202934067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202934075 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202934076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202934076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:37.027711 run osmo-msc_10.42.42.6(pid=24469): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24469)] 20:29:37.077650 run osmo-msc_10.42.42.6(pid=24469): stdout: | (launched: 2022-12-12_20:29:35.874333) 20:29:37.129296 run osmo-msc_10.42.42.6(pid=24469): stderr: | 20221212202936197 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202936197 DLGLOBAL DEBUG validating counter group 0x7f0aadd97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202936197 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202936197 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202936197 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202936197 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202936199 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202936199 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202936200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202936200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:29:37.181220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24459): Terminating (SIGTERM) 20:29:37.222635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24465): Terminating (SIGTERM) 20:29:37.264174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24468): Terminating (SIGTERM) 20:29:37.305904 --- ParallelTerminationStrategy: PID 24459 died... 20:29:37.325571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24459): Terminated: ok {rc=0} 20:29:37.371696 --- ParallelTerminationStrategy: PID 24465 died... 20:29:37.391076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24465): Terminated: ok {rc=0} 20:29:37.437319 --- ParallelTerminationStrategy: PID 24468 died... 20:29:37.456865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24468): Terminated: ok {rc=0} 20:29:37.546158 bus /sierra_3: Setting Powered False 20:29:38.646882 bus /sierra_3: Setting Powered False 20:29:39.763445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 20:29:41.019216 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:29:41.025369 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 20:29:41.075767 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 20:29:41.103354 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 20:29:41.158473 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 20:29:41.209268 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 20:29:41.236799 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 20:29:41.786424 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 20:29:41.791985 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:29:41.803345 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 20:29:41.837183 tst handover.py: using LAC 31317 20:29:41.965473 tst handover.py: using RAC 207 20:29:42.087051 tst handover.py: using CellId 31317 20:29:42.207565 tst handover.py: using BVCI 31318 20:29:42.320051 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 20:29:42.368425 tst handover.py: using LAC 31318 20:29:42.489184 tst handover.py: using RAC 208 20:29:42.609072 tst handover.py: using CellId 31318 20:29:42.737994 tst handover.py: using BVCI 31319 20:29:42.857072 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:29:42.868557 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:29:42.879954 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:29:42.891386 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:29:42.902698 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 20:29:42.913923 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 20:29:43.029531 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 20:29:43.143000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:43.590547 run create_hlr_db(pid=24474): Launched 20:29:43.711044 bus /sierra_2: Setting Powered False 20:29:44.771940 run create_hlr_db(pid=24474): Terminated: ok {rc=0} 20:29:45.192167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24476): Launched 20:29:45.523074 run osmo-hlr_10.42.42.2(pid=24477): Launched 20:29:45.650897 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:46.177968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24479): Launched 20:29:46.511309 run osmo-stp_10.42.42.5(pid=24480): Launched 20:29:46.807508 run osmo-msc_10.42.42.6: Starting osmo-msc 20:29:47.550214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24482): Launched 20:29:47.882312 run osmo-msc_10.42.42.6(pid=24483): Launched 20:29:48.064737 run osmo-stp_10.42.42.5(pid=24480): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24480)] 20:29:48.203369 run osmo-stp_10.42.42.5(pid=24480): stdout: | (launched: 2022-12-12_20:29:46.449594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:48.342067 run osmo-stp_10.42.42.5(pid=24480): stderr: | 20221212202946842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202946842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202946842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202946842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202946843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202946843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202946843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:48.479430 run osmo-stp_10.42.42.5(pid=24480): stdout: | (launched: 2022-12-12_20:29:46.449594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:48.610963 run osmo-stp_10.42.42.5(pid=24480): stderr: | 20221212202946842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202946842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202946842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202946842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202946843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202946843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202946843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:48.766981 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24480): Process ended prematurely: osmo-stp_10.42.42.5(pid=24480) [trial-2381↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24480)] [trial-2381↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 20:29:48.776157 tst handover.py:18: Test FAILED (7.0 sec) 20:29:48.804034 run osmo-hlr_10.42.42.2(pid=24477): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24477)] 20:29:48.854178 run osmo-hlr_10.42.42.2(pid=24477): stdout: | (launched: 2022-12-12_20:29:45.462010) 20:29:48.905983 run osmo-hlr_10.42.42.2(pid=24477): stderr: | 20221212202945661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202945661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202945661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202945661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202945661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202945661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202945673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202945682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202945682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202945682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:48.978350 run osmo-msc_10.42.42.6(pid=24483): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24483)] 20:29:49.028412 run osmo-msc_10.42.42.6(pid=24483): stdout: | (launched: 2022-12-12_20:29:47.820875) 20:29:49.080215 run osmo-msc_10.42.42.6(pid=24483): stderr: | 20221212202948144 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202948144 DLGLOBAL DEBUG validating counter group 0x7fd0e3c83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202948144 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202948144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202948144 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202948145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202948146 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202948147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202948147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202948147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:29:49.132460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24476): Terminating (SIGTERM) 20:29:49.174272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24479): Terminating (SIGTERM) 20:29:49.216059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24482): Terminating (SIGTERM) 20:29:49.259111 --- ParallelTerminationStrategy: PID 24476 died... 20:29:49.279423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24476): Terminated: ok {rc=0} 20:29:49.326043 --- ParallelTerminationStrategy: PID 24479 died... 20:29:49.345890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24479): Terminated: ok {rc=0} 20:29:49.392146 --- ParallelTerminationStrategy: PID 24482 died... 20:29:49.412082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24482): Terminated: ok {rc=0} 20:29:49.500877 bus /sierra_3: Setting Powered False 20:29:50.601781 bus /sierra_3: Setting Powered False 20:29:51.719096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 20:29:52.979930 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:29:52.985790 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 20:29:53.032672 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:29:53.060411 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:29:53.115553 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 20:29:53.161620 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:29:53.188355 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:29:53.741155 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 20:29:53.747001 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:29:53.758876 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:29:53.795652 tst handover.py: using LAC 31319 20:29:53.926148 tst handover.py: using RAC 209 20:29:54.054218 tst handover.py: using CellId 31319 20:29:54.182121 tst handover.py: using BVCI 31320 20:29:54.300643 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:29:54.346473 tst handover.py: using LAC 31320 20:29:54.476930 tst handover.py: using RAC 210 20:29:54.604833 tst handover.py: using CellId 31320 20:29:54.734514 tst handover.py: using BVCI 31321 20:29:54.852915 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:29:54.864543 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:29:54.875909 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:29:54.887302 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:29:54.898755 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:29:54.910224 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:29:55.026446 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:29:55.143069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:55.592834 run create_hlr_db(pid=24488): Launched 20:29:55.711451 bus /sierra_2: Setting Powered False 20:29:56.772505 run create_hlr_db(pid=24488): Terminated: ok {rc=0} 20:29:57.195318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24490): Launched 20:29:57.527653 run osmo-hlr_10.42.42.2(pid=24491): Launched 20:29:57.656050 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:58.199064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24493): Launched 20:29:58.528488 run osmo-stp_10.42.42.5(pid=24494): Launched 20:29:58.654417 run osmo-msc_10.42.42.6: Starting osmo-msc 20:29:59.219009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24496): Launched 20:29:59.550808 run osmo-msc_10.42.42.6(pid=24497): Launched 20:29:59.735771 run osmo-stp_10.42.42.5(pid=24494): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24494)] 20:29:59.873890 run osmo-stp_10.42.42.5(pid=24494): stdout: | (launched: 2022-12-12_20:29:58.466821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:00.013240 run osmo-stp_10.42.42.5(pid=24494): stderr: | 20221212202958660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202958660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202958661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202958661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202958661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202958661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202958662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:00.149556 run osmo-stp_10.42.42.5(pid=24494): stdout: | (launched: 2022-12-12_20:29:58.466821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:00.279808 run osmo-stp_10.42.42.5(pid=24494): stderr: | 20221212202958660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212202958660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212202958661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212202958661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212202958661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212202958661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212202958662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:00.436155 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24494): Process ended prematurely: osmo-stp_10.42.42.5(pid=24494) [trial-2381↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24494)] [trial-2381↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 20:30:00.445481 tst handover.py:18: Test FAILED (6.7 sec) 20:30:00.473183 run osmo-hlr_10.42.42.2(pid=24491): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24491)] 20:30:00.523702 run osmo-hlr_10.42.42.2(pid=24491): stdout: | (launched: 2022-12-12_20:29:57.466251) 20:30:00.575768 run osmo-hlr_10.42.42.2(pid=24491): stderr: | 20221212202957666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212202957666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212202957666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212202957667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212202957667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212202957667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212202957679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212202957690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212202957690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212202957690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:00.648101 run osmo-msc_10.42.42.6(pid=24497): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24497)] 20:30:00.698013 run osmo-msc_10.42.42.6(pid=24497): stdout: | (launched: 2022-12-12_20:29:59.489458) 20:30:00.749727 run osmo-msc_10.42.42.6(pid=24497): stderr: | 20221212202959813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212202959813 DLGLOBAL DEBUG validating counter group 0x7feb5dd1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212202959813 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212202959813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212202959813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212202959813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212202959815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212202959815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212202959816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212202959816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:30:00.801773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24490): Terminating (SIGTERM) 20:30:00.843591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24493): Terminating (SIGTERM) 20:30:00.896328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24496): Terminating (SIGTERM) 20:30:00.939146 --- ParallelTerminationStrategy: PID 24490 died... 20:30:00.967967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24490): Terminated: ok {rc=0} 20:30:01.019552 --- ParallelTerminationStrategy: PID 24493 died... 20:30:01.044110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24493): Terminated: ok {rc=0} 20:30:01.111057 --- ParallelTerminationStrategy: PID 24496 died... 20:30:01.136731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24496): Terminated: ok {rc=0} 20:30:01.225041 bus /sierra_3: Setting Powered False 20:30:02.325123 bus /sierra_3: Setting Powered False 20:30:03.441458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 20:30:04.691866 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:30:04.697203 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 20:30:04.747210 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:30:04.773960 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:30:04.827666 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 20:30:04.877413 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:30:04.903904 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:30:05.452921 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 20:30:05.458425 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:30:05.469614 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:30:05.504224 tst handover.py: using LAC 31321 20:30:05.633073 tst handover.py: using RAC 211 20:30:05.762255 tst handover.py: using CellId 31321 20:30:05.891585 tst handover.py: using BVCI 31322 20:30:06.012387 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:30:06.062673 tst handover.py: using LAC 31322 20:30:06.192307 tst handover.py: using RAC 212 20:30:06.322927 tst handover.py: using CellId 31322 20:30:06.450436 tst handover.py: using BVCI 31323 20:30:06.569781 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:30:06.581377 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:30:06.592680 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:30:06.604176 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:30:06.615533 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:30:06.627001 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:30:06.742535 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:30:06.863338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:07.343224 run create_hlr_db(pid=24505): Launched 20:30:07.475945 bus /sierra_2: Setting Powered False 20:30:08.541507 run create_hlr_db(pid=24505): Terminated: ok {rc=0} 20:30:08.953432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24507): Launched 20:30:09.260411 run osmo-hlr_10.42.42.2(pid=24508): Launched 20:30:09.378988 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:09.893382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24510): Launched 20:30:10.202046 run osmo-stp_10.42.42.5(pid=24511): Launched 20:30:10.321279 run osmo-msc_10.42.42.6: Starting osmo-msc 20:30:10.849533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24513): Launched 20:30:11.158627 run osmo-msc_10.42.42.6(pid=24514): Launched 20:30:11.330703 run osmo-stp_10.42.42.5(pid=24511): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24511)] 20:30:11.461153 run osmo-stp_10.42.42.5(pid=24511): stdout: | (launched: 2022-12-12_20:30:10.145143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:11.591052 run osmo-stp_10.42.42.5(pid=24511): stderr: | 20221212203010315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203010315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203010315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203010316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203010316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203010316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203010316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:11.718635 run osmo-stp_10.42.42.5(pid=24511): stdout: | (launched: 2022-12-12_20:30:10.145143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:11.840380 run osmo-stp_10.42.42.5(pid=24511): stderr: | 20221212203010315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203010315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203010315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203010316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203010316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203010316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203010316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:11.986556 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24511): Process ended prematurely: osmo-stp_10.42.42.5(pid=24511) [trial-2381↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24511)] [trial-2381↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 20:30:11.994896 tst handover.py:18: Test FAILED (6.5 sec) 20:30:12.021839 run osmo-hlr_10.42.42.2(pid=24508): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24508)] 20:30:12.070593 run osmo-hlr_10.42.42.2(pid=24508): stdout: | (launched: 2022-12-12_20:30:09.203597) 20:30:12.120798 run osmo-hlr_10.42.42.2(pid=24508): stderr: | 20221212203009380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203009380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203009380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203009380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203009380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203009381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203009393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203009401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203009401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203009401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:12.190471 run osmo-msc_10.42.42.6(pid=24514): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24514)] 20:30:12.238536 run osmo-msc_10.42.42.6(pid=24514): stdout: | (launched: 2022-12-12_20:30:11.101405) 20:30:12.288280 run osmo-msc_10.42.42.6(pid=24514): stderr: | 20221212203011372 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203011373 DLGLOBAL DEBUG validating counter group 0x7fbcbce22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203011373 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203011373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203011373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203011373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203011376 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203011376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203011376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203011377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:30:12.338571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24507): Terminating (SIGTERM) 20:30:12.378770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24510): Terminating (SIGTERM) 20:30:12.419206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24513): Terminating (SIGTERM) 20:30:12.459945 --- ParallelTerminationStrategy: PID 24507 died... 20:30:12.479208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24507): Terminated: ok {rc=0} 20:30:12.525152 --- ParallelTerminationStrategy: PID 24510 died... 20:30:12.543928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24510): Terminated: ok {rc=0} 20:30:12.588793 --- ParallelTerminationStrategy: PID 24513 died... 20:30:12.608098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24513): Terminated: ok {rc=0} 20:30:12.695950 bus /sierra_3: Setting Powered False 20:30:13.796184 bus /sierra_3: Setting Powered False 20:30:14.912311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 20:30:16.196216 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:30:16.205931 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:30:16.256534 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:30:16.292865 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:30:16.358160 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:30:16.405283 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:30:16.439831 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:30:16.980639 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 20:30:16.990031 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:30:17.015396 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 20:30:17.053128 tst handover.py: using LAC 31323 20:30:17.219493 tst handover.py: using RAC 213 20:30:17.350666 tst handover.py: using CellId 31323 20:30:17.479570 tst handover.py: using BVCI 31324 20:30:17.599004 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 20:30:17.633472 tst handover.py: using LAC 31324 20:30:17.760107 tst handover.py: using RAC 214 20:30:17.886273 tst handover.py: using CellId 31324 20:30:18.012670 tst handover.py: using BVCI 31325 20:30:18.131518 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:30:18.142849 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:30:18.153979 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:30:18.165179 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:30:18.176243 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:30:18.187312 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 20:30:18.302930 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 20:30:18.418466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:18.866754 run create_hlr_db(pid=24519): Launched 20:30:18.986050 bus /sierra_2: Setting Powered False 20:30:20.047493 run create_hlr_db(pid=24519): Terminated: ok {rc=0} 20:30:20.468457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24521): Launched 20:30:20.798585 run osmo-hlr_10.42.42.2(pid=24522): Launched 20:30:20.925785 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:21.460576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24524): Launched 20:30:21.787800 run osmo-stp_10.42.42.5(pid=24525): Launched 20:30:21.914312 run osmo-msc_10.42.42.6: Starting osmo-msc 20:30:22.478634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24527): Launched 20:30:22.806203 run osmo-msc_10.42.42.6(pid=24528): Launched 20:30:22.989810 run osmo-stp_10.42.42.5(pid=24525): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24525)] 20:30:23.127449 run osmo-stp_10.42.42.5(pid=24525): stdout: | (launched: 2022-12-12_20:30:21.727457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:23.265862 run osmo-stp_10.42.42.5(pid=24525): stderr: | 20221212203021918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203021918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203021919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203021919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203021919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203021920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203021920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:23.402036 run osmo-stp_10.42.42.5(pid=24525): stdout: | (launched: 2022-12-12_20:30:21.727457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:23.532349 run osmo-stp_10.42.42.5(pid=24525): stderr: | 20221212203021918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203021918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203021919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203021919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203021919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203021920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203021920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:23.688306 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24525): Process ended prematurely: osmo-stp_10.42.42.5(pid=24525) [trial-2381↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24525)] [trial-2381↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 20:30:23.697276 tst handover.py:18: Test FAILED (6.7 sec) 20:30:23.724790 run osmo-hlr_10.42.42.2(pid=24522): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24522)] 20:30:23.775051 run osmo-hlr_10.42.42.2(pid=24522): stdout: | (launched: 2022-12-12_20:30:20.738166) 20:30:23.827057 run osmo-hlr_10.42.42.2(pid=24522): stderr: | 20221212203020935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203020935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203020935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203020935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203020935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203020935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203020950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203020959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203020959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203020959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:23.899786 run osmo-msc_10.42.42.6(pid=24528): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24528)] 20:30:23.949940 run osmo-msc_10.42.42.6(pid=24528): stdout: | (launched: 2022-12-12_20:30:22.745554) 20:30:24.001790 run osmo-msc_10.42.42.6(pid=24528): stderr: | 20221212203023067 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203023067 DLGLOBAL DEBUG validating counter group 0x7ff9298cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203023067 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203023067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203023068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203023068 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203023070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203023070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203023070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203023070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:30:24.053883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24521): Terminating (SIGTERM) 20:30:24.095658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24524): Terminating (SIGTERM) 20:30:24.137940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24527): Terminating (SIGTERM) 20:30:24.180034 --- ParallelTerminationStrategy: PID 24521 died... 20:30:24.200119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24521): Terminated: ok {rc=0} 20:30:24.246275 --- ParallelTerminationStrategy: PID 24524 died... 20:30:24.265795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24524): Terminated: ok {rc=0} 20:30:24.311783 --- ParallelTerminationStrategy: PID 24527 died... 20:30:24.331472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24527): Terminated: ok {rc=0} 20:30:24.419204 bus /sierra_3: Setting Powered False 20:30:25.521363 bus /sierra_3: Setting Powered False 20:30:26.641944 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 20:30:27.880525 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:30:27.885944 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:30:27.935330 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:30:27.961892 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:30:28.014791 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:30:28.063767 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:30:28.090586 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:30:28.639693 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 20:30:28.645143 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:30:28.655935 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:30:28.689331 tst handover.py: using LAC 31325 20:30:28.809143 tst handover.py: using RAC 215 20:30:28.930734 tst handover.py: using CellId 31325 20:30:29.050288 tst handover.py: using BVCI 31326 20:30:29.162535 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:30:29.210027 tst handover.py: using LAC 31326 20:30:29.332259 tst handover.py: using RAC 216 20:30:29.456093 tst handover.py: using CellId 31326 20:30:29.575904 tst handover.py: using BVCI 31327 20:30:29.695712 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:30:29.707240 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:30:29.718650 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:30:29.730289 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:30:29.741900 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:30:29.753721 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:30:29.870205 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:30:29.988227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:30.469473 run create_hlr_db(pid=24533): Launched 20:30:30.604526 bus /sierra_2: Setting Powered False 20:30:31.697216 run create_hlr_db(pid=24533): Terminated: ok {rc=0} 20:30:32.170510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24535): Launched 20:30:32.511238 run osmo-hlr_10.42.42.2(pid=24536): Launched 20:30:32.639170 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:33.174011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24538): Launched 20:30:33.502655 run osmo-stp_10.42.42.5(pid=24539): Launched 20:30:33.629634 run osmo-msc_10.42.42.6: Starting osmo-msc 20:30:34.192272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24541): Launched 20:30:34.522526 run osmo-msc_10.42.42.6(pid=24542): Launched 20:30:34.707582 run osmo-stp_10.42.42.5(pid=24539): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24539)] 20:30:34.844599 run osmo-stp_10.42.42.5(pid=24539): stdout: | (launched: 2022-12-12_20:30:33.442153) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:34.982042 run osmo-stp_10.42.42.5(pid=24539): stderr: | 20221212203033634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203033634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203033635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203033635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203033635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203033636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203033636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:35.118395 run osmo-stp_10.42.42.5(pid=24539): stdout: | (launched: 2022-12-12_20:30:33.442153) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:35.248781 run osmo-stp_10.42.42.5(pid=24539): stderr: | 20221212203033634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203033634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203033635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203033635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203033635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203033636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203033636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:35.404601 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24539): Process ended prematurely: osmo-stp_10.42.42.5(pid=24539) [trial-2381↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24539)] [trial-2381↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 20:30:35.413714 tst handover.py:18: Test FAILED (6.8 sec) 20:30:35.441676 run osmo-hlr_10.42.42.2(pid=24536): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24536)] 20:30:35.492002 run osmo-hlr_10.42.42.2(pid=24536): stdout: | (launched: 2022-12-12_20:30:32.450829) 20:30:35.544428 run osmo-hlr_10.42.42.2(pid=24536): stderr: | 20221212203032649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203032649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203032649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203032649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203032649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203032649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203032662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203032672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203032672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203032672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:35.617071 run osmo-msc_10.42.42.6(pid=24542): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24542)] 20:30:35.667372 run osmo-msc_10.42.42.6(pid=24542): stdout: | (launched: 2022-12-12_20:30:34.461726) 20:30:35.719126 run osmo-msc_10.42.42.6(pid=24542): stderr: | 20221212203034786 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203034786 DLGLOBAL DEBUG validating counter group 0x7fc6d8e60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203034786 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203034786 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203034786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203034787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203034788 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203034789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203034789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203034789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:30:35.771490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24535): Terminating (SIGTERM) 20:30:35.813338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24538): Terminating (SIGTERM) 20:30:35.855237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24541): Terminating (SIGTERM) 20:30:35.898269 --- ParallelTerminationStrategy: PID 24535 died... 20:30:35.918614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24535): Terminated: ok {rc=0} 20:30:35.965952 --- ParallelTerminationStrategy: PID 24538 died... 20:30:35.986034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24538): Terminated: ok {rc=0} 20:30:36.033042 --- ParallelTerminationStrategy: PID 24541 died... 20:30:36.052882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24541): Terminated: ok {rc=0} 20:30:36.142595 bus /sierra_3: Setting Powered False 20:30:37.242651 bus /sierra_3: Setting Powered False 20:30:38.359911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 20:30:39.618477 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:30:39.624275 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:30:39.676166 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:30:39.703500 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:30:39.755714 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:30:39.804080 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:30:39.830920 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:30:40.381696 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 20:30:40.387171 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:30:40.398179 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:30:40.435573 tst handover.py: using LAC 31327 20:30:40.553410 tst handover.py: using RAC 217 20:30:40.671821 tst handover.py: using CellId 31327 20:30:40.789863 tst handover.py: using BVCI 31328 20:30:40.902473 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:30:40.951670 tst handover.py: using LAC 31328 20:30:41.071578 tst handover.py: using RAC 218 20:30:41.189139 tst handover.py: using CellId 31328 20:30:41.307308 tst handover.py: using BVCI 31329 20:30:41.417893 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:30:41.428782 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:30:41.439741 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:30:41.450945 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:30:41.462177 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:30:41.473166 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:30:41.593525 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:30:41.716013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:42.198015 run create_hlr_db(pid=24547): Launched 20:30:42.334149 bus /sierra_2: Setting Powered False 20:30:43.399032 run create_hlr_db(pid=24547): Terminated: ok {rc=0} 20:30:43.828603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24549): Launched 20:30:44.159056 run osmo-hlr_10.42.42.2(pid=24550): Launched 20:30:44.286113 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:44.826644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24552): Launched 20:30:45.156361 run osmo-stp_10.42.42.5(pid=24553): Launched 20:30:45.281524 run osmo-msc_10.42.42.6: Starting osmo-msc 20:30:45.853663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24555): Launched 20:30:46.181463 run osmo-msc_10.42.42.6(pid=24556): Launched 20:30:46.490649 run osmo-stp_10.42.42.5(pid=24553): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24553)] 20:30:46.717905 run osmo-stp_10.42.42.5(pid=24553): stdout: | (launched: 2022-12-12_20:30:45.095147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:47.003870 run osmo-stp_10.42.42.5(pid=24553): stderr: | 20221212203045287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203045287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203045287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203045287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203045288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203045288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203045288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:47.142955 run osmo-stp_10.42.42.5(pid=24553): stdout: | (launched: 2022-12-12_20:30:45.095147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:47.304203 run osmo-stp_10.42.42.5(pid=24553): stderr: | 20221212203045287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203045287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203045287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203045287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203045288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203045288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203045288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:47.459423 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24553): Process ended prematurely: osmo-stp_10.42.42.5(pid=24553) [trial-2381↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24553)] [trial-2381↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 20:30:47.468489 tst handover.py:18: Test FAILED (7.1 sec) 20:30:47.496559 run osmo-hlr_10.42.42.2(pid=24550): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24550)] 20:30:47.546804 run osmo-hlr_10.42.42.2(pid=24550): stdout: | (launched: 2022-12-12_20:30:44.098282) 20:30:47.598265 run osmo-hlr_10.42.42.2(pid=24550): stderr: | 20221212203044296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203044296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203044296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203044297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203044297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203044297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203044309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203044318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203044319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203044319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:47.669393 run osmo-msc_10.42.42.6(pid=24556): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24556)] 20:30:47.718567 run osmo-msc_10.42.42.6(pid=24556): stdout: | (launched: 2022-12-12_20:30:46.121928) 20:30:47.769689 run osmo-msc_10.42.42.6(pid=24556): stderr: | 20221212203046685 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203046687 DLGLOBAL DEBUG validating counter group 0x7f1cb97bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203046687 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203046688 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203046689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203046691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203046701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203046704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203046705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203046705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:30:47.820246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24549): Terminating (SIGTERM) 20:30:47.861955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24552): Terminating (SIGTERM) 20:30:47.903549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24555): Terminating (SIGTERM) 20:30:47.944694 --- ParallelTerminationStrategy: PID 24549 died... 20:30:47.964218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24549): Terminated: ok {rc=0} 20:30:48.010298 --- ParallelTerminationStrategy: PID 24552 died... 20:30:48.029268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24552): Terminated: ok {rc=0} 20:30:48.075536 --- ParallelTerminationStrategy: PID 24555 died... 20:30:48.094491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24555): Terminated: ok {rc=0} 20:30:48.182395 bus /sierra_3: Setting Powered False 20:30:49.283795 bus /sierra_3: Setting Powered False 20:30:50.402285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 20:30:51.665338 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:30:51.671021 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 20:30:51.731593 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:30:51.759079 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:30:51.815738 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 20:30:51.877034 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:30:51.905016 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:30:52.455153 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 20:30:52.461924 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:30:52.474187 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:30:52.527151 tst handover.py: using LAC 31329 20:30:52.656359 tst handover.py: using RAC 219 20:30:52.784368 tst handover.py: using CellId 31329 20:30:52.912678 tst handover.py: using BVCI 31330 20:30:53.031381 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:30:53.077396 tst handover.py: using LAC 31330 20:30:53.206937 tst handover.py: using RAC 220 20:30:53.337337 tst handover.py: using CellId 31330 20:30:53.464937 tst handover.py: using BVCI 31331 20:30:53.583897 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:30:53.595462 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:30:53.606908 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:30:53.618404 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:30:53.630018 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:30:53.641669 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:30:53.757302 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:30:53.875681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:54.324122 run create_hlr_db(pid=24561): Launched 20:30:54.443177 bus /sierra_2: Setting Powered False 20:30:55.504145 run create_hlr_db(pid=24561): Terminated: ok {rc=0} 20:30:55.923828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24563): Launched 20:30:56.255030 run osmo-hlr_10.42.42.2(pid=24564): Launched 20:30:56.382861 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:56.920926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24566): Launched 20:30:57.251277 run osmo-stp_10.42.42.5(pid=24567): Launched 20:30:57.378388 run osmo-msc_10.42.42.6: Starting osmo-msc 20:30:57.944738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24569): Launched 20:30:58.275487 run osmo-msc_10.42.42.6(pid=24570): Launched 20:30:58.461472 run osmo-stp_10.42.42.5(pid=24567): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24567)] 20:30:58.600323 run osmo-stp_10.42.42.5(pid=24567): stdout: | (launched: 2022-12-12_20:30:57.190712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:58.738961 run osmo-stp_10.42.42.5(pid=24567): stderr: | 20221212203057383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203057383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203057384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203057384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203057384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203057385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203057385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:58.875714 run osmo-stp_10.42.42.5(pid=24567): stdout: | (launched: 2022-12-12_20:30:57.190712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:59.005821 run osmo-stp_10.42.42.5(pid=24567): stderr: | 20221212203057383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203057383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203057384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203057384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203057384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203057385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203057385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:59.161856 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24567): Process ended prematurely: osmo-stp_10.42.42.5(pid=24567) [trial-2381↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24567)] [trial-2381↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 20:30:59.170903 tst handover.py:18: Test FAILED (6.7 sec) 20:30:59.198790 run osmo-hlr_10.42.42.2(pid=24564): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24564)] 20:30:59.248910 run osmo-hlr_10.42.42.2(pid=24564): stdout: | (launched: 2022-12-12_20:30:56.194543) 20:30:59.300872 run osmo-hlr_10.42.42.2(pid=24564): stderr: | 20221212203056393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203056393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203056393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203056393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203056393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203056393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203056409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203056417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203056417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203056417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:59.373780 run osmo-msc_10.42.42.6(pid=24570): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24570)] 20:30:59.423887 run osmo-msc_10.42.42.6(pid=24570): stdout: | (launched: 2022-12-12_20:30:58.214724) 20:30:59.475494 run osmo-msc_10.42.42.6(pid=24570): stderr: | 20221212203058537 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203058537 DLGLOBAL DEBUG validating counter group 0x7f6200683c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203058537 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203058537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203058537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203058538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203058539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203058540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203058540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203058540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:30:59.527523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24563): Terminating (SIGTERM) 20:30:59.569363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24566): Terminating (SIGTERM) 20:30:59.610959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24569): Terminating (SIGTERM) 20:30:59.652860 --- ParallelTerminationStrategy: PID 24563 died... 20:30:59.673077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24563): Terminated: ok {rc=0} 20:30:59.719771 --- ParallelTerminationStrategy: PID 24566 died... 20:30:59.739565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24566): Terminated: ok {rc=0} 20:30:59.786906 --- ParallelTerminationStrategy: PID 24569 died... 20:30:59.806816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24569): Terminated: ok {rc=0} 20:30:59.894800 bus /sierra_3: Setting Powered False 20:31:01.002091 bus /sierra_3: Setting Powered False 20:31:02.147087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 20:31:03.427963 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:31:03.433190 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 20:31:03.497297 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:31:03.523972 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:31:03.578425 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 20:31:03.643385 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:31:03.670162 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:31:04.218683 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 20:31:04.223847 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:04.234920 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:31:04.282861 tst handover.py: using LAC 31331 20:31:04.403412 tst handover.py: using RAC 221 20:31:04.523130 tst handover.py: using CellId 31331 20:31:04.644355 tst handover.py: using BVCI 31332 20:31:04.756484 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:31:04.805843 tst handover.py: using LAC 31332 20:31:04.926404 tst handover.py: using RAC 222 20:31:05.046858 tst handover.py: using CellId 31332 20:31:05.167673 tst handover.py: using BVCI 31333 20:31:05.278184 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:05.289236 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:05.300074 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:05.311285 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:05.322521 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:05.333765 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:31:05.454030 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:31:05.575967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:06.056558 run create_hlr_db(pid=24576): Launched 20:31:06.191540 bus /sierra_2: Setting Powered False 20:31:07.255694 run create_hlr_db(pid=24576): Terminated: ok {rc=0} 20:31:07.669756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24578): Launched 20:31:07.983156 run osmo-hlr_10.42.42.2(pid=24579): Launched 20:31:08.100830 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:08.614838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24581): Launched 20:31:08.921484 run osmo-stp_10.42.42.5(pid=24582): Launched 20:31:09.039807 run osmo-msc_10.42.42.6: Starting osmo-msc 20:31:09.567353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24584): Launched 20:31:09.876091 run osmo-msc_10.42.42.6(pid=24585): Launched 20:31:10.049613 run osmo-stp_10.42.42.5(pid=24582): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24582)] 20:31:10.180029 run osmo-stp_10.42.42.5(pid=24582): stdout: | (launched: 2022-12-12_20:31:08.864598) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:10.309318 run osmo-stp_10.42.42.5(pid=24582): stderr: | 20221212203109036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203109036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203109036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203109037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203109037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203109037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203109037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:10.436738 run osmo-stp_10.42.42.5(pid=24582): stdout: | (launched: 2022-12-12_20:31:08.864598) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:10.559494 run osmo-stp_10.42.42.5(pid=24582): stderr: | 20221212203109036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203109036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203109036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203109037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203109037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203109037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203109037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:10.705637 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24582): Process ended prematurely: osmo-stp_10.42.42.5(pid=24582) [trial-2381↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24582)] [trial-2381↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 20:31:10.713843 tst handover.py:18: Test FAILED (6.5 sec) 20:31:10.740517 run osmo-hlr_10.42.42.2(pid=24579): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24579)] 20:31:10.789308 run osmo-hlr_10.42.42.2(pid=24579): stdout: | (launched: 2022-12-12_20:31:07.925372) 20:31:10.839568 run osmo-hlr_10.42.42.2(pid=24579): stderr: | 20221212203108099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203108099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203108099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203108099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203108099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203108099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203108112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203108120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203108120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203108120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:10.909977 run osmo-msc_10.42.42.6(pid=24585): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24585)] 20:31:10.958398 run osmo-msc_10.42.42.6(pid=24585): stdout: | (launched: 2022-12-12_20:31:09.818733) 20:31:11.008593 run osmo-msc_10.42.42.6(pid=24585): stderr: | 20221212203110088 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203110088 DLGLOBAL DEBUG validating counter group 0x7fd0c47c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203110088 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203110088 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203110089 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203110089 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203110091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203110091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203110091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203110091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:31:11.059222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24578): Terminating (SIGTERM) 20:31:11.099490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24581): Terminating (SIGTERM) 20:31:11.139820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24584): Terminating (SIGTERM) 20:31:11.180299 --- ParallelTerminationStrategy: PID 24578 died... 20:31:11.199777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24578): Terminated: ok {rc=0} 20:31:11.244669 --- ParallelTerminationStrategy: PID 24581 died... 20:31:11.263406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24581): Terminated: ok {rc=0} 20:31:11.308252 --- ParallelTerminationStrategy: PID 24584 died... 20:31:11.327107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24584): Terminated: ok {rc=0} 20:31:11.415466 bus /sierra_3: Setting Powered False 20:31:12.517172 bus /sierra_3: Setting Powered False 20:31:13.634249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 20:31:14.914033 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:31:14.919503 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:31:14.972147 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:31:14.999619 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:31:15.053202 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:31:15.104784 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:31:15.132240 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:31:15.683041 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 20:31:15.689010 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:31:15.700398 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 20:31:15.749315 tst handover.py: using LAC 31333 20:31:15.887726 tst handover.py: using RAC 223 20:31:16.022535 tst handover.py: using CellId 31333 20:31:16.151732 tst handover.py: using BVCI 31334 20:31:16.298621 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 20:31:16.333969 tst handover.py: using LAC 31334 20:31:16.463724 tst handover.py: using RAC 224 20:31:16.589156 tst handover.py: using CellId 31334 20:31:16.712733 tst handover.py: using BVCI 31335 20:31:16.834249 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:31:16.846087 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:31:16.857904 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:31:16.870180 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:31:16.882031 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:31:16.893705 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 20:31:17.017756 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 20:31:17.165275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:17.643302 run create_hlr_db(pid=24590): Launched 20:31:17.762589 bus /sierra_2: Setting Powered False 20:31:18.823411 run create_hlr_db(pid=24590): Terminated: ok {rc=0} 20:31:19.243048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24592): Launched 20:31:19.573881 run osmo-hlr_10.42.42.2(pid=24593): Launched 20:31:19.697096 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:20.212015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24595): Launched 20:31:20.519749 run osmo-stp_10.42.42.5(pid=24596): Launched 20:31:20.640400 run osmo-msc_10.42.42.6: Starting osmo-msc 20:31:21.169431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24598): Launched 20:31:21.476424 run osmo-msc_10.42.42.6(pid=24599): Launched 20:31:21.650716 run osmo-stp_10.42.42.5(pid=24596): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24596)] 20:31:21.780170 run osmo-stp_10.42.42.5(pid=24596): stdout: | (launched: 2022-12-12_20:31:20.462700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:21.910159 run osmo-stp_10.42.42.5(pid=24596): stderr: | 20221212203120634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203120634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203120634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203120635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203120635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203120635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203120635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:22.037494 run osmo-stp_10.42.42.5(pid=24596): stdout: | (launched: 2022-12-12_20:31:20.462700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:22.159464 run osmo-stp_10.42.42.5(pid=24596): stderr: | 20221212203120634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203120634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203120634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203120635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203120635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203120635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203120635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:22.305506 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24596): Process ended prematurely: osmo-stp_10.42.42.5(pid=24596) [trial-2381↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24596)] [trial-2381↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 20:31:22.314057 tst handover.py:18: Test FAILED (6.6 sec) 20:31:22.341968 run osmo-hlr_10.42.42.2(pid=24593): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24593)] 20:31:22.392236 run osmo-hlr_10.42.42.2(pid=24593): stdout: | (launched: 2022-12-12_20:31:19.512503) 20:31:22.442250 run osmo-hlr_10.42.42.2(pid=24593): stderr: | 20221212203119691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203119691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203119691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203119691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203119692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203119692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203119704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203119712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203119712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203119712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:22.511993 run osmo-msc_10.42.42.6(pid=24599): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24599)] 20:31:22.560408 run osmo-msc_10.42.42.6(pid=24599): stdout: | (launched: 2022-12-12_20:31:21.419191) 20:31:22.610563 run osmo-msc_10.42.42.6(pid=24599): stderr: | 20221212203121692 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203121692 DLGLOBAL DEBUG validating counter group 0x7f2cd2f66c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203121692 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203121692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203121692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203121693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203121694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203121695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203121695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203121695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:31:22.660918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24592): Terminating (SIGTERM) 20:31:22.700694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24595): Terminating (SIGTERM) 20:31:22.740679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24598): Terminating (SIGTERM) 20:31:22.780806 --- ParallelTerminationStrategy: PID 24592 died... 20:31:22.800039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24592): Terminated: ok {rc=0} 20:31:22.845229 --- ParallelTerminationStrategy: PID 24595 died... 20:31:22.863712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24595): Terminated: ok {rc=0} 20:31:22.908377 --- ParallelTerminationStrategy: PID 24598 died... 20:31:22.927458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24598): Terminated: ok {rc=0} 20:31:23.012435 bus /sierra_3: Setting Powered False 20:31:24.111189 bus /sierra_3: Setting Powered False 20:31:25.230416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 20:31:26.484034 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:31:26.489325 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:31:26.552203 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:31:26.578651 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:31:26.633791 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:31:26.697115 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:31:26.724254 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:31:27.270691 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 20:31:27.275883 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:31:27.286724 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:31:27.334474 tst handover.py: using LAC 31335 20:31:27.455054 tst handover.py: using RAC 225 20:31:27.575090 tst handover.py: using CellId 31335 20:31:27.694642 tst handover.py: using BVCI 31336 20:31:27.804573 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:31:27.853171 tst handover.py: using LAC 31336 20:31:27.973510 tst handover.py: using RAC 226 20:31:28.094126 tst handover.py: using CellId 31336 20:31:28.212923 tst handover.py: using BVCI 31337 20:31:28.322734 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:31:28.333686 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:31:28.344399 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:31:28.355492 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:31:28.366479 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:31:28.377478 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:31:28.492846 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:31:28.612578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:29.094281 run create_hlr_db(pid=24604): Launched 20:31:29.228033 bus /sierra_2: Setting Powered False 20:31:30.293262 run create_hlr_db(pid=24604): Terminated: ok {rc=0} 20:31:30.723024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24606): Launched 20:31:31.080003 run osmo-hlr_10.42.42.2(pid=24607): Launched 20:31:31.267771 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:31.927191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24609): Launched 20:31:32.279732 run osmo-stp_10.42.42.5(pid=24610): Launched 20:31:32.510833 run osmo-msc_10.42.42.6: Starting osmo-msc 20:31:33.080661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24612): Launched 20:31:33.412121 run osmo-msc_10.42.42.6(pid=24613): Launched 20:31:33.596518 run osmo-stp_10.42.42.5(pid=24610): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24610)] 20:31:33.734482 run osmo-stp_10.42.42.5(pid=24610): stdout: | (launched: 2022-12-12_20:31:32.221761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:33.872424 run osmo-stp_10.42.42.5(pid=24610): stderr: | 20221212203132423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203132423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203132424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203132424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203132425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203132425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203132425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:34.009605 run osmo-stp_10.42.42.5(pid=24610): stdout: | (launched: 2022-12-12_20:31:32.221761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:34.140103 run osmo-stp_10.42.42.5(pid=24610): stderr: | 20221212203132423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203132423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203132424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203132424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203132425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203132425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203132425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:34.296839 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24610): Process ended prematurely: osmo-stp_10.42.42.5(pid=24610) [trial-2381↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24610)] [trial-2381↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 20:31:34.305941 tst handover.py:18: Test FAILED (7.0 sec) 20:31:34.333798 run osmo-hlr_10.42.42.2(pid=24607): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24607)] 20:31:34.384220 run osmo-hlr_10.42.42.2(pid=24607): stdout: | (launched: 2022-12-12_20:31:31.018232) 20:31:34.436586 run osmo-hlr_10.42.42.2(pid=24607): stderr: | 20221212203131392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203131392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203131392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203131392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203131393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203131393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203131417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203131432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203131435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203131436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:34.509310 run osmo-msc_10.42.42.6(pid=24613): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24613)] 20:31:34.560051 run osmo-msc_10.42.42.6(pid=24613): stdout: | (launched: 2022-12-12_20:31:33.351456) 20:31:34.612176 run osmo-msc_10.42.42.6(pid=24613): stderr: | 20221212203133675 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203133675 DLGLOBAL DEBUG validating counter group 0x7ff19fcf6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203133676 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203133676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203133676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203133676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203133678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203133678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203133678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203133678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:31:34.664814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24606): Terminating (SIGTERM) 20:31:34.707069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24609): Terminating (SIGTERM) 20:31:34.748760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24612): Terminating (SIGTERM) 20:31:34.791051 --- ParallelTerminationStrategy: PID 24606 died... 20:31:34.811232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24606): Terminated: ok {rc=0} 20:31:34.857878 --- ParallelTerminationStrategy: PID 24609 died... 20:31:34.877673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24609): Terminated: ok {rc=0} 20:31:34.924145 --- ParallelTerminationStrategy: PID 24612 died... 20:31:34.944079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24612): Terminated: ok {rc=0} 20:31:35.033387 bus /sierra_3: Setting Powered False 20:31:36.133597 bus /sierra_3: Setting Powered False 20:31:37.250231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 20:31:38.528840 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:31:38.534509 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:31:38.598709 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:31:38.626527 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:31:38.681012 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:31:38.745704 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:31:38.773116 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:31:39.322715 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 20:31:39.328158 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:31:39.339652 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:31:39.389052 tst handover.py: using LAC 31337 20:31:39.521350 tst handover.py: using RAC 227 20:31:39.649492 tst handover.py: using CellId 31337 20:31:39.777402 tst handover.py: using BVCI 31338 20:31:39.898004 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:31:39.945410 tst handover.py: using LAC 31338 20:31:40.072712 tst handover.py: using RAC 228 20:31:40.202819 tst handover.py: using CellId 31338 20:31:40.331224 tst handover.py: using BVCI 31339 20:31:40.449700 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:31:40.461048 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:31:40.472199 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:31:40.483549 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:31:40.494825 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:31:40.506041 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:31:40.621972 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:31:40.741653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:41.222375 run create_hlr_db(pid=24618): Launched 20:31:41.357094 bus /sierra_2: Setting Powered False 20:31:42.422092 run create_hlr_db(pid=24618): Terminated: ok {rc=0} 20:31:42.852521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24620): Launched 20:31:43.182478 run osmo-hlr_10.42.42.2(pid=24621): Launched 20:31:43.309163 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:43.845774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24623): Launched 20:31:44.175188 run osmo-stp_10.42.42.5(pid=24624): Launched 20:31:44.301954 run osmo-msc_10.42.42.6: Starting osmo-msc 20:31:44.867702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24626): Launched 20:31:45.195461 run osmo-msc_10.42.42.6(pid=24627): Launched 20:31:45.379835 run osmo-stp_10.42.42.5(pid=24624): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24624)] 20:31:45.517820 run osmo-stp_10.42.42.5(pid=24624): stdout: | (launched: 2022-12-12_20:31:44.114506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:45.656816 run osmo-stp_10.42.42.5(pid=24624): stderr: | 20221212203144306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203144307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203144307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203144307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203144308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203144308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203144308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:45.793375 run osmo-stp_10.42.42.5(pid=24624): stdout: | (launched: 2022-12-12_20:31:44.114506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:45.942208 run osmo-stp_10.42.42.5(pid=24624): stderr: | 20221212203144306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203144307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203144307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203144307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203144308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203144308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203144308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:46.094713 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24624): Process ended prematurely: osmo-stp_10.42.42.5(pid=24624) [trial-2381↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24624)] [trial-2381↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 20:31:46.104305 tst handover.py:18: Test FAILED (6.8 sec) 20:31:46.133630 run osmo-hlr_10.42.42.2(pid=24621): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24621)] 20:31:46.186969 run osmo-hlr_10.42.42.2(pid=24621): stdout: | (launched: 2022-12-12_20:31:43.121911) 20:31:46.240617 run osmo-hlr_10.42.42.2(pid=24621): stderr: | 20221212203143319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203143319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203143320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203143320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203143320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203143320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203143366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203143375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203143375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203143375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:46.313954 run osmo-msc_10.42.42.6(pid=24627): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24627)] 20:31:46.366046 run osmo-msc_10.42.42.6(pid=24627): stdout: | (launched: 2022-12-12_20:31:45.134792) 20:31:46.419631 run osmo-msc_10.42.42.6(pid=24627): stderr: | 20221212203145456 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203145456 DLGLOBAL DEBUG validating counter group 0x7f86e7f55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203145456 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203145456 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203145456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203145457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203145458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203145459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203145459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203145459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:31:46.473303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24620): Terminating (SIGTERM) 20:31:46.516791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24623): Terminating (SIGTERM) 20:31:46.562699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24626): Terminating (SIGTERM) 20:31:46.609689 --- ParallelTerminationStrategy: PID 24620 died... 20:31:46.630240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24620): Terminated: ok {rc=0} 20:31:46.680461 --- ParallelTerminationStrategy: PID 24623 died... 20:31:46.701616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24623): Terminated: ok {rc=0} 20:31:46.751009 --- ParallelTerminationStrategy: PID 24626 died... 20:31:46.771338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24626): Terminated: ok {rc=0} 20:31:46.861850 bus /sierra_3: Setting Powered False 20:31:47.959220 bus /sierra_3: Setting Powered False 20:31:49.076404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 20:31:50.345362 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:31:50.350599 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 20:31:50.409629 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:31:50.437295 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:31:50.491622 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 20:31:50.552829 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:31:50.579798 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:31:51.129519 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 20:31:51.134869 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:51.146208 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:31:51.190336 tst handover.py: using LAC 31339 20:31:51.311562 tst handover.py: using RAC 229 20:31:51.435473 tst handover.py: using CellId 31339 20:31:51.555366 tst handover.py: using BVCI 31340 20:31:51.665995 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:31:51.715720 tst handover.py: using LAC 31340 20:31:51.844196 tst handover.py: using RAC 230 20:31:51.973691 tst handover.py: using CellId 31340 20:31:52.093989 tst handover.py: using BVCI 31341 20:31:52.204216 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:52.215575 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:52.226894 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:52.238307 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:52.249702 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:31:52.260942 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:31:52.376446 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:31:52.492691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:52.941569 run create_hlr_db(pid=24632): Launched 20:31:53.061074 bus /sierra_2: Setting Powered False 20:31:54.122535 run create_hlr_db(pid=24632): Terminated: ok {rc=0} 20:31:54.524360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Launched 20:31:54.831814 run osmo-hlr_10.42.42.2(pid=24635): Launched 20:31:54.950297 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:55.449282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Launched 20:31:55.758039 run osmo-stp_10.42.42.5(pid=24638): Launched 20:31:55.877149 run osmo-msc_10.42.42.6: Starting osmo-msc 20:31:56.407091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24640): Launched 20:31:56.716100 run osmo-msc_10.42.42.6(pid=24641): Launched 20:31:56.888634 run osmo-stp_10.42.42.5(pid=24638): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] 20:31:57.018625 run osmo-stp_10.42.42.5(pid=24638): stdout: | (launched: 2022-12-12_20:31:55.700721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:57.147923 run osmo-stp_10.42.42.5(pid=24638): stderr: | 20221212203155871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203155871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203155871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203155872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203155872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203155872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203155872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:57.274989 run osmo-stp_10.42.42.5(pid=24638): stdout: | (launched: 2022-12-12_20:31:55.700721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:57.396397 run osmo-stp_10.42.42.5(pid=24638): stderr: | 20221212203155871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203155871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203155871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203155872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203155872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203155872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203155872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:57.542223 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24638): Process ended prematurely: osmo-stp_10.42.42.5(pid=24638) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 20:31:57.550692 tst handover.py:18: Test FAILED (6.4 sec) 20:31:57.577473 run osmo-hlr_10.42.42.2(pid=24635): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24635)] 20:31:57.626026 run osmo-hlr_10.42.42.2(pid=24635): stdout: | (launched: 2022-12-12_20:31:54.774490) 20:31:57.675866 run osmo-hlr_10.42.42.2(pid=24635): stderr: | 20221212203154951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203154951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203154951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203154951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203154951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203154951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203154983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203154992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203154993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203154993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:57.745901 run osmo-msc_10.42.42.6(pid=24641): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24641)] 20:31:57.793932 run osmo-msc_10.42.42.6(pid=24641): stdout: | (launched: 2022-12-12_20:31:56.658851) 20:31:57.843602 run osmo-msc_10.42.42.6(pid=24641): stderr: | 20221212203156930 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203156930 DLGLOBAL DEBUG validating counter group 0x7fb1e6a1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203156931 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203156931 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203156931 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203156931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203156933 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203156933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203156933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203156933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:31:57.893587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Terminating (SIGTERM) 20:31:57.933575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Terminating (SIGTERM) 20:31:57.973574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24640): Terminating (SIGTERM) 20:31:58.013839 --- ParallelTerminationStrategy: PID 24634 died... 20:31:58.033061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Terminated: ok {rc=0} 20:31:58.077763 --- ParallelTerminationStrategy: PID 24637 died... 20:31:58.096360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Terminated: ok {rc=0} 20:31:58.140917 --- ParallelTerminationStrategy: PID 24640 died... 20:31:58.159945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24640): Terminated: ok {rc=0} 20:31:58.246567 bus /sierra_3: Setting Powered False 20:31:59.344898 bus /sierra_3: Setting Powered False 20:32:00.460323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 20:32:01.759254 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:01.764870 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:32:01.816128 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:32:01.844628 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:32:01.901748 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:32:01.980258 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:32:02.012149 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:32:02.529818 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 20:32:02.535293 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:02.546839 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 20:32:02.591935 tst handover.py: using LAC 31341 20:32:02.718302 tst handover.py: using RAC 231 20:32:02.844070 tst handover.py: using CellId 31341 20:32:02.975286 tst handover.py: using BVCI 31342 20:32:03.093761 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 20:32:03.128686 tst handover.py: using LAC 31342 20:32:03.247370 tst handover.py: using RAC 232 20:32:03.369101 tst handover.py: using CellId 31342 20:32:03.490086 tst handover.py: using BVCI 31343 20:32:03.600573 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:03.611839 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:03.622851 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:03.634552 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:03.646087 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:03.657420 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 20:32:03.777507 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 20:32:03.894240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:04.344371 run create_hlr_db(pid=24646): Launched 20:32:04.461888 bus /sierra_2: Setting Powered False 20:32:05.523076 run create_hlr_db(pid=24646): Terminated: ok {rc=0} 20:32:05.942611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24648): Launched 20:32:06.272005 run osmo-hlr_10.42.42.2(pid=24649): Launched 20:32:06.399312 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:06.934936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24651): Launched 20:32:07.265088 run osmo-stp_10.42.42.5(pid=24652): Launched 20:32:07.389773 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:07.955087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24654): Launched 20:32:08.284705 run osmo-msc_10.42.42.6(pid=24655): Launched 20:32:08.469458 run osmo-stp_10.42.42.5(pid=24652): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24652)] 20:32:08.607947 run osmo-stp_10.42.42.5(pid=24652): stdout: | (launched: 2022-12-12_20:32:07.204317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:08.746942 run osmo-stp_10.42.42.5(pid=24652): stderr: | 20221212203207398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203207399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203207399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203207399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203207400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203207400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203207400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:08.883430 run osmo-stp_10.42.42.5(pid=24652): stdout: | (launched: 2022-12-12_20:32:07.204317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:09.014536 run osmo-stp_10.42.42.5(pid=24652): stderr: | 20221212203207398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203207399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203207399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203207399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203207400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203207400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203207400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:09.170574 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24652): Process ended prematurely: osmo-stp_10.42.42.5(pid=24652) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24652)] [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 20:32:09.179476 tst handover.py:18: Test FAILED (6.6 sec) 20:32:09.207070 run osmo-hlr_10.42.42.2(pid=24649): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24649)] 20:32:09.256823 run osmo-hlr_10.42.42.2(pid=24649): stdout: | (launched: 2022-12-12_20:32:06.211042) 20:32:09.308716 run osmo-hlr_10.42.42.2(pid=24649): stderr: | 20221212203206409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203206409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203206409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203206409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203206409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203206409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203206466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203206476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203206476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203206476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:09.381265 run osmo-msc_10.42.42.6(pid=24655): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24655)] 20:32:09.431322 run osmo-msc_10.42.42.6(pid=24655): stdout: | (launched: 2022-12-12_20:32:08.223621) 20:32:09.483382 run osmo-msc_10.42.42.6(pid=24655): stderr: | 20221212203208546 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203208546 DLGLOBAL DEBUG validating counter group 0x7fee2ae0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203208546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203208546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203208547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203208547 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203208548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203208549 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203208549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203208549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:09.535500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24648): Terminating (SIGTERM) 20:32:09.577761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24651): Terminating (SIGTERM) 20:32:09.619758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24654): Terminating (SIGTERM) 20:32:09.662017 --- ParallelTerminationStrategy: PID 24648 died... 20:32:09.682242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24648): Terminated: ok {rc=0} 20:32:09.728746 --- ParallelTerminationStrategy: PID 24651 died... 20:32:09.748636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24651): Terminated: ok {rc=0} 20:32:09.794850 --- ParallelTerminationStrategy: PID 24654 died... 20:32:09.814567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24654): Terminated: ok {rc=0} 20:32:09.902554 bus /sierra_3: Setting Powered False 20:32:11.001168 bus /sierra_3: Setting Powered False 20:32:12.116581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 20:32:13.387535 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:13.394863 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:32:13.457981 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:32:13.485852 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:32:13.540278 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:32:13.601762 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:32:13.629153 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:32:14.183368 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 20:32:14.188810 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:14.200385 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:32:14.247807 tst handover.py: using LAC 31343 20:32:14.378727 tst handover.py: using RAC 233 20:32:14.508047 tst handover.py: using CellId 31343 20:32:14.630522 tst handover.py: using BVCI 31344 20:32:14.741525 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:32:14.790529 tst handover.py: using LAC 31344 20:32:14.910473 tst handover.py: using RAC 234 20:32:15.031290 tst handover.py: using CellId 31344 20:32:15.153137 tst handover.py: using BVCI 31345 20:32:15.266411 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:15.277934 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:15.289100 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:15.300719 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:15.312435 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:15.324415 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:32:15.445065 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:32:15.568083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:16.068754 run create_hlr_db(pid=24660): Launched 20:32:16.236171 bus /sierra_2: Setting Powered False 20:32:17.308410 run create_hlr_db(pid=24660): Terminated: ok {rc=0} 20:32:17.717252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24662): Launched 20:32:18.025044 run osmo-hlr_10.42.42.2(pid=24663): Launched 20:32:18.143645 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:18.644512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24665): Launched 20:32:18.953801 run osmo-stp_10.42.42.5(pid=24666): Launched 20:32:19.073792 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:19.600635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24668): Launched 20:32:19.908305 run osmo-msc_10.42.42.6(pid=24669): Launched 20:32:20.081274 run osmo-stp_10.42.42.5(pid=24666): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24666)] 20:32:20.210496 run osmo-stp_10.42.42.5(pid=24666): stdout: | (launched: 2022-12-12_20:32:18.896693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:20.339789 run osmo-stp_10.42.42.5(pid=24666): stderr: | 20221212203219067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203219067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203219067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203219068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203219068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203219068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203219068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:20.466824 run osmo-stp_10.42.42.5(pid=24666): stdout: | (launched: 2022-12-12_20:32:18.896693) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:20.588216 run osmo-stp_10.42.42.5(pid=24666): stderr: | 20221212203219067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203219067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203219067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203219068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203219068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203219068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203219068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:20.733526 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24666): Process ended prematurely: osmo-stp_10.42.42.5(pid=24666) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24666)] [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 20:32:20.741929 tst handover.py:18: Test FAILED (6.5 sec) 20:32:20.768868 run osmo-hlr_10.42.42.2(pid=24663): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24663)] 20:32:20.816670 run osmo-hlr_10.42.42.2(pid=24663): stdout: | (launched: 2022-12-12_20:32:17.967785) 20:32:20.866356 run osmo-hlr_10.42.42.2(pid=24663): stderr: | 20221212203218142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203218142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203218142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203218142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203218142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203218142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203218155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203218163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203218163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203218164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:20.935416 run osmo-msc_10.42.42.6(pid=24669): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24669)] 20:32:20.983023 run osmo-msc_10.42.42.6(pid=24669): stdout: | (launched: 2022-12-12_20:32:19.851218) 20:32:21.032444 run osmo-msc_10.42.42.6(pid=24669): stderr: | 20221212203220121 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203220122 DLGLOBAL DEBUG validating counter group 0x7f2ea2dd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203220122 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203220122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203220122 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203220122 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203220124 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203220124 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203220124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203220124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:21.082464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24662): Terminating (SIGTERM) 20:32:21.122174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24665): Terminating (SIGTERM) 20:32:21.162122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24668): Terminating (SIGTERM) 20:32:21.202135 --- ParallelTerminationStrategy: PID 24662 died... 20:32:21.221056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24662): Terminated: ok {rc=0} 20:32:21.265715 --- ParallelTerminationStrategy: PID 24665 died... 20:32:21.284368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24665): Terminated: ok {rc=0} 20:32:21.328524 --- ParallelTerminationStrategy: PID 24668 died... 20:32:21.347170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24668): Terminated: ok {rc=0} 20:32:21.432163 bus /sierra_3: Setting Powered False 20:32:22.531214 bus /sierra_3: Setting Powered False 20:32:23.649726 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 20:32:24.924211 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:24.930322 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:32:24.990258 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:32:25.017885 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:32:25.073017 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:32:25.133164 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:32:25.160334 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:32:25.712037 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 20:32:25.717635 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:32:25.729113 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:32:25.774418 tst handover.py: using LAC 31345 20:32:25.904380 tst handover.py: using RAC 235 20:32:26.026673 tst handover.py: using CellId 31345 20:32:26.148287 tst handover.py: using BVCI 31346 20:32:26.261192 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:32:26.309344 tst handover.py: using LAC 31346 20:32:26.431411 tst handover.py: using RAC 236 20:32:26.553564 tst handover.py: using CellId 31346 20:32:26.682803 tst handover.py: using BVCI 31347 20:32:26.802572 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:32:26.814273 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:32:26.825762 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:32:26.837326 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:32:26.848733 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:32:26.860342 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:32:26.976110 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:32:27.096354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:27.578547 run create_hlr_db(pid=24674): Launched 20:32:27.712844 bus /sierra_2: Setting Powered False 20:32:28.778616 run create_hlr_db(pid=24674): Terminated: ok {rc=0} 20:32:29.193736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24676): Launched 20:32:29.501580 run osmo-hlr_10.42.42.2(pid=24677): Launched 20:32:29.621128 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:30.138336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24679): Launched 20:32:30.447053 run osmo-stp_10.42.42.5(pid=24680): Launched 20:32:30.566869 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:31.127728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24682): Launched 20:32:31.481745 run osmo-msc_10.42.42.6(pid=24683): Launched 20:32:31.728453 run osmo-stp_10.42.42.5(pid=24680): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24680)] 20:32:31.906971 run osmo-stp_10.42.42.5(pid=24680): stdout: | (launched: 2022-12-12_20:32:30.389494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:32.115134 run osmo-stp_10.42.42.5(pid=24680): stderr: | 20221212203230558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203230558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203230558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203230559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203230559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203230559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203230559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:32.315363 run osmo-stp_10.42.42.5(pid=24680): stdout: | (launched: 2022-12-12_20:32:30.389494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:32.437501 run osmo-stp_10.42.42.5(pid=24680): stderr: | 20221212203230558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203230558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203230558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203230559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203230559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203230559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203230559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:32.583505 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24680): Process ended prematurely: osmo-stp_10.42.42.5(pid=24680) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24680)] [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 20:32:32.591778 tst handover.py:18: Test FAILED (6.9 sec) 20:32:32.618734 run osmo-hlr_10.42.42.2(pid=24677): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24677)] 20:32:32.667350 run osmo-hlr_10.42.42.2(pid=24677): stdout: | (launched: 2022-12-12_20:32:29.444116) 20:32:32.717525 run osmo-hlr_10.42.42.2(pid=24677): stderr: | 20221212203229618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203229618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203229618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203229619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203229619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203229619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203229631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203229639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203229639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203229639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:32.787325 run osmo-msc_10.42.42.6(pid=24683): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24683)] 20:32:32.835487 run osmo-msc_10.42.42.6(pid=24683): stdout: | (launched: 2022-12-12_20:32:31.416072) 20:32:32.885389 run osmo-msc_10.42.42.6(pid=24683): stderr: | 20221212203232030 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203232031 DLGLOBAL DEBUG validating counter group 0x7fe8b8a5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203232031 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203232031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203232031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203232031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203232033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203232033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203232033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203232033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:32.935737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24676): Terminating (SIGTERM) 20:32:32.975474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24679): Terminating (SIGTERM) 20:32:33.015277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24682): Terminating (SIGTERM) 20:32:33.055336 --- ParallelTerminationStrategy: PID 24676 died... 20:32:33.074708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24676): Terminated: ok {rc=0} 20:32:33.119581 --- ParallelTerminationStrategy: PID 24679 died... 20:32:33.138477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24679): Terminated: ok {rc=0} 20:32:33.183086 --- ParallelTerminationStrategy: PID 24682 died... 20:32:33.201816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24682): Terminated: ok {rc=0} 20:32:33.289019 bus /sierra_3: Setting Powered False 20:32:34.389764 bus /sierra_3: Setting Powered False 20:32:35.506847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 20:32:36.781722 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:36.787886 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:32:36.840565 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:32:36.867287 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:32:36.922505 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:32:36.973816 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:32:37.001568 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:32:37.550586 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 20:32:37.556194 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:37.567418 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 20:32:37.616441 tst handover.py: using LAC 31347 20:32:37.737362 tst handover.py: using RAC 237 20:32:37.859746 tst handover.py: using CellId 31347 20:32:37.980714 tst handover.py: using BVCI 31348 20:32:38.091318 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 20:32:38.126048 tst handover.py: using LAC 31348 20:32:38.246476 tst handover.py: using RAC 238 20:32:38.367497 tst handover.py: using CellId 31348 20:32:38.488727 tst handover.py: using BVCI 31349 20:32:38.599596 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:38.610826 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:38.621891 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:38.633459 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:38.644900 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:32:38.656370 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 20:32:38.775625 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 20:32:38.892036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:39.343293 run create_hlr_db(pid=24688): Launched 20:32:39.462879 bus /sierra_2: Setting Powered False 20:32:40.524268 run create_hlr_db(pid=24688): Terminated: ok {rc=0} 20:32:40.927272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24690): Launched 20:32:41.236793 run osmo-hlr_10.42.42.2(pid=24691): Launched 20:32:41.355238 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:41.858339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24693): Launched 20:32:42.167676 run osmo-stp_10.42.42.5(pid=24694): Launched 20:32:42.285563 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:42.813541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24696): Launched 20:32:43.119997 run osmo-msc_10.42.42.6(pid=24697): Launched 20:32:43.293254 run osmo-stp_10.42.42.5(pid=24694): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24694)] 20:32:43.423018 run osmo-stp_10.42.42.5(pid=24694): stdout: | (launched: 2022-12-12_20:32:42.110670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:43.552547 run osmo-stp_10.42.42.5(pid=24694): stderr: | 20221212203242279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203242280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203242280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203242280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203242281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203242281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203242281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:43.680325 run osmo-stp_10.42.42.5(pid=24694): stdout: | (launched: 2022-12-12_20:32:42.110670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:43.802218 run osmo-stp_10.42.42.5(pid=24694): stderr: | 20221212203242279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203242280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203242280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203242280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203242281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203242281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203242281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:43.947691 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24694): Process ended prematurely: osmo-stp_10.42.42.5(pid=24694) [trial-2381↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24694)] [trial-2381↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 20:32:43.956191 tst handover.py:18: Test FAILED (6.4 sec) 20:32:43.982823 run osmo-hlr_10.42.42.2(pid=24691): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24691)] 20:32:44.030897 run osmo-hlr_10.42.42.2(pid=24691): stdout: | (launched: 2022-12-12_20:32:41.179146) 20:32:44.080706 run osmo-hlr_10.42.42.2(pid=24691): stderr: | 20221212203241355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203241355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203241355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203241355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203241355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203241355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203241367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203241375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203241376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203241376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:44.149963 run osmo-msc_10.42.42.6(pid=24697): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24697)] 20:32:44.197685 run osmo-msc_10.42.42.6(pid=24697): stdout: | (launched: 2022-12-12_20:32:43.063030) 20:32:44.247164 run osmo-msc_10.42.42.6(pid=24697): stderr: | 20221212203243335 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203243335 DLGLOBAL DEBUG validating counter group 0x7f236e84dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203243335 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203243335 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203243336 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203243336 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203243338 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203243338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203243338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203243338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:44.297149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24690): Terminating (SIGTERM) 20:32:44.337063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24693): Terminating (SIGTERM) 20:32:44.377025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24696): Terminating (SIGTERM) 20:32:44.417401 --- ParallelTerminationStrategy: PID 24690 died... 20:32:44.436549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24690): Terminated: ok {rc=0} 20:32:44.481809 --- ParallelTerminationStrategy: PID 24693 died... 20:32:44.500742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24693): Terminated: ok {rc=0} 20:32:44.545438 --- ParallelTerminationStrategy: PID 24696 died... 20:32:44.564363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24696): Terminated: ok {rc=0} 20:32:44.651446 bus /sierra_3: Setting Powered False 20:32:45.752553 bus /sierra_3: Setting Powered False 20:32:46.882776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 20:32:48.147321 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:48.153205 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:32:48.218246 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:32:48.245780 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:32:48.300717 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:32:48.366913 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:32:48.393620 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:32:48.945290 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 20:32:48.951842 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:48.964036 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:32:49.014598 tst handover.py: using LAC 31349 20:32:49.136247 tst handover.py: using RAC 239 20:32:49.258283 tst handover.py: using CellId 31349 20:32:49.387814 tst handover.py: using BVCI 31350 20:32:49.506315 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:32:49.555707 tst handover.py: using LAC 31350 20:32:49.685975 tst handover.py: using RAC 240 20:32:49.813740 tst handover.py: using CellId 31350 20:32:49.941821 tst handover.py: using BVCI 31351 20:32:50.061703 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:50.073260 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:50.084612 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:50.096084 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:50.107454 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:32:50.118894 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:32:50.240173 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:32:50.357137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:50.808749 run create_hlr_db(pid=24702): Launched 20:32:50.926541 bus /sierra_2: Setting Powered False 20:32:51.988353 run create_hlr_db(pid=24702): Terminated: ok {rc=0} 20:32:52.391065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24705): Launched 20:32:52.700262 run osmo-hlr_10.42.42.2(pid=24706): Launched 20:32:52.817507 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:53.332761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24708): Launched 20:32:53.641954 run osmo-stp_10.42.42.5(pid=24709): Launched 20:32:53.761203 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:54.290291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24711): Launched 20:32:54.600000 run osmo-msc_10.42.42.6(pid=24712): Launched 20:32:54.772119 run osmo-stp_10.42.42.5(pid=24709): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24709)] 20:32:54.901570 run osmo-stp_10.42.42.5(pid=24709): stdout: | (launched: 2022-12-12_20:32:53.584464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:55.030755 run osmo-stp_10.42.42.5(pid=24709): stderr: | 20221212203253754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203253754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203253754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203253755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203253755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203253755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203253755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:55.157935 run osmo-stp_10.42.42.5(pid=24709): stdout: | (launched: 2022-12-12_20:32:53.584464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:55.279238 run osmo-stp_10.42.42.5(pid=24709): stderr: | 20221212203253754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203253754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203253754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203253755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203253755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203253755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203253755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:55.425552 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24709): Process ended prematurely: osmo-stp_10.42.42.5(pid=24709) [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24709)] [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 20:32:55.434018 tst handover.py:18: Test FAILED (6.5 sec) 20:32:55.460679 run osmo-hlr_10.42.42.2(pid=24706): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24706)] 20:32:55.509347 run osmo-hlr_10.42.42.2(pid=24706): stdout: | (launched: 2022-12-12_20:32:52.643236) 20:32:55.559310 run osmo-hlr_10.42.42.2(pid=24706): stderr: | 20221212203252821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203252821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203252821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203252821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203252821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203252821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203252832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203252840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203252841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203252841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:55.629228 run osmo-msc_10.42.42.6(pid=24712): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24712)] 20:32:55.677531 run osmo-msc_10.42.42.6(pid=24712): stdout: | (launched: 2022-12-12_20:32:54.542877) 20:32:55.727149 run osmo-msc_10.42.42.6(pid=24712): stderr: | 20221212203254812 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203254813 DLGLOBAL DEBUG validating counter group 0x7faec8fc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203254813 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203254813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203254813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203254813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203254815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203254815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203254815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203254815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:55.777290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24705): Terminating (SIGTERM) 20:32:55.817316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24708): Terminating (SIGTERM) 20:32:55.857335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24711): Terminating (SIGTERM) 20:32:55.898022 --- ParallelTerminationStrategy: PID 24705 died... 20:32:55.917251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24705): Terminated: ok {rc=0} 20:32:55.961846 --- ParallelTerminationStrategy: PID 24708 died... 20:32:55.980605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24708): Terminated: ok {rc=0} 20:32:56.025056 --- ParallelTerminationStrategy: PID 24711 died... 20:32:56.043776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24711): Terminated: ok {rc=0} 20:32:56.130004 bus /sierra_3: Setting Powered False 20:32:57.227777 bus /sierra_3: Setting Powered False 20:32:58.343568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 20:32:59.614253 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:59.619652 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:32:59.682259 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:32:59.708544 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:32:59.763551 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:32:59.827753 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:32:59.854082 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:33:00.401959 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 20:33:00.407380 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:00.418608 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:33:00.466719 tst handover.py: using LAC 31351 20:33:00.593377 tst handover.py: using RAC 241 20:33:00.711760 tst handover.py: using CellId 31351 20:33:00.828920 tst handover.py: using BVCI 31352 20:33:00.956321 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:33:01.006998 tst handover.py: using LAC 31352 20:33:01.135846 tst handover.py: using RAC 242 20:33:01.295674 tst handover.py: using CellId 31352 20:33:01.429355 tst handover.py: using BVCI 31353 20:33:01.553180 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:01.565737 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:01.579488 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:01.591570 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:01.604626 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:01.617407 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:33:01.757586 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:33:01.888906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:02.382613 run create_hlr_db(pid=24718): Launched 20:33:02.518015 bus /sierra_2: Setting Powered False 20:33:03.583495 run create_hlr_db(pid=24718): Terminated: ok {rc=0} 20:33:03.996586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24720): Launched 20:33:04.305852 run osmo-hlr_10.42.42.2(pid=24721): Launched 20:33:04.425075 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:04.938404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24723): Launched 20:33:05.246730 run osmo-stp_10.42.42.5(pid=24724): Launched 20:33:05.365204 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:05.891912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24726): Launched 20:33:06.200657 run osmo-msc_10.42.42.6(pid=24727): Launched 20:33:06.385431 run osmo-stp_10.42.42.5(pid=24724): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24724)] 20:33:06.515349 run osmo-stp_10.42.42.5(pid=24724): stdout: | (launched: 2022-12-12_20:33:05.189379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:06.644282 run osmo-stp_10.42.42.5(pid=24724): stderr: | 20221212203305358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203305358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203305359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203305359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203305359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203305360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203305360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:06.771972 run osmo-stp_10.42.42.5(pid=24724): stdout: | (launched: 2022-12-12_20:33:05.189379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:06.894373 run osmo-stp_10.42.42.5(pid=24724): stderr: | 20221212203305358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203305358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203305359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203305359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203305359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203305360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203305360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:07.040496 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24724): Process ended prematurely: osmo-stp_10.42.42.5(pid=24724) [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24724)] [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 20:33:07.049051 tst handover.py:18: Test FAILED (6.6 sec) 20:33:07.076138 run osmo-hlr_10.42.42.2(pid=24721): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24721)] 20:33:07.124532 run osmo-hlr_10.42.42.2(pid=24721): stdout: | (launched: 2022-12-12_20:33:04.248396) 20:33:07.174415 run osmo-hlr_10.42.42.2(pid=24721): stderr: | 20221212203304425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203304425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203304426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203304426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203304426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203304426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203304438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203304449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203304449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203304449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:07.243801 run osmo-msc_10.42.42.6(pid=24727): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24727)] 20:33:07.291991 run osmo-msc_10.42.42.6(pid=24727): stdout: | (launched: 2022-12-12_20:33:06.143352) 20:33:07.341789 run osmo-msc_10.42.42.6(pid=24727): stderr: | 20221212203306413 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203306414 DLGLOBAL DEBUG validating counter group 0x7fba20f3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203306414 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203306414 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203306414 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203306414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203306416 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203306416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203306416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203306416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:07.392550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24720): Terminating (SIGTERM) 20:33:07.432454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24723): Terminating (SIGTERM) 20:33:07.472920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24726): Terminating (SIGTERM) 20:33:07.513430 --- ParallelTerminationStrategy: PID 24720 died... 20:33:07.532715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24720): Terminated: ok {rc=0} 20:33:07.577487 --- ParallelTerminationStrategy: PID 24723 died... 20:33:07.596127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24723): Terminated: ok {rc=0} 20:33:07.640911 --- ParallelTerminationStrategy: PID 24726 died... 20:33:07.660179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24726): Terminated: ok {rc=0} 20:33:07.747482 bus /sierra_3: Setting Powered False 20:33:08.848194 bus /sierra_3: Setting Powered False 20:33:09.964896 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 20:33:11.238368 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:11.245361 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:33:11.298187 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:33:11.325801 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:33:11.379893 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:33:11.432066 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:33:11.460084 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:33:12.014361 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 20:33:12.020213 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:33:12.031697 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:33:12.070846 tst handover.py: using LAC 31353 20:33:12.198617 tst handover.py: using RAC 243 20:33:12.324697 tst handover.py: using CellId 31353 20:33:12.453726 tst handover.py: using BVCI 31354 20:33:12.573691 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:33:12.622345 tst handover.py: using LAC 31354 20:33:12.749024 tst handover.py: using RAC 244 20:33:12.875429 tst handover.py: using CellId 31354 20:33:13.001315 tst handover.py: using BVCI 31355 20:33:13.122107 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:33:13.133530 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:33:13.144684 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:33:13.156078 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:33:13.167449 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:33:13.178802 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:33:13.294262 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:33:13.410437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:13.860669 run create_hlr_db(pid=24732): Launched 20:33:13.980005 bus /sierra_2: Setting Powered False 20:33:15.041798 run create_hlr_db(pid=24732): Terminated: ok {rc=0} 20:33:15.445279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24734): Launched 20:33:15.755979 run osmo-hlr_10.42.42.2(pid=24735): Launched 20:33:15.923806 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:16.560569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24737): Launched 20:33:16.902603 run osmo-stp_10.42.42.5(pid=24738): Launched 20:33:17.190647 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:17.738687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24740): Launched 20:33:18.044193 run osmo-msc_10.42.42.6(pid=24741): Launched 20:33:18.214020 run osmo-stp_10.42.42.5(pid=24738): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24738)] 20:33:18.343152 run osmo-stp_10.42.42.5(pid=24738): stdout: | (launched: 2022-12-12_20:33:16.839848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:18.471629 run osmo-stp_10.42.42.5(pid=24738): stderr: | 20221212203317039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203317040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203317040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203317040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203317041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203317041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203317041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:18.598668 run osmo-stp_10.42.42.5(pid=24738): stdout: | (launched: 2022-12-12_20:33:16.839848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:18.719563 run osmo-stp_10.42.42.5(pid=24738): stderr: | 20221212203317039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203317040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203317040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203317040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203317041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203317041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203317041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:18.864336 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24738): Process ended prematurely: osmo-stp_10.42.42.5(pid=24738) [trial-2381↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24738)] [trial-2381↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 20:33:18.872896 tst handover.py:18: Test FAILED (6.8 sec) 20:33:18.899788 run osmo-hlr_10.42.42.2(pid=24735): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24735)] 20:33:18.948643 run osmo-hlr_10.42.42.2(pid=24735): stdout: | (launched: 2022-12-12_20:33:15.698957) 20:33:18.998937 run osmo-hlr_10.42.42.2(pid=24735): stderr: | 20221212203315872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203315872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203315872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203315872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203315872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203315873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203315888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203315904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203315904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203315904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:19.069359 run osmo-msc_10.42.42.6(pid=24741): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24741)] 20:33:19.117931 run osmo-msc_10.42.42.6(pid=24741): stdout: | (launched: 2022-12-12_20:33:17.986555) 20:33:19.168253 run osmo-msc_10.42.42.6(pid=24741): stderr: | 20221212203318255 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203318256 DLGLOBAL DEBUG validating counter group 0x7f8cf8982c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203318256 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203318256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203318256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203318256 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203318258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203318258 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203318258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203318258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:19.218802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24734): Terminating (SIGTERM) 20:33:19.259276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24737): Terminating (SIGTERM) 20:33:19.300299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24740): Terminating (SIGTERM) 20:33:19.341147 --- ParallelTerminationStrategy: PID 24734 died... 20:33:19.360536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24734): Terminated: ok {rc=0} 20:33:19.405502 --- ParallelTerminationStrategy: PID 24737 died... 20:33:19.424311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24737): Terminated: ok {rc=0} 20:33:19.469238 --- ParallelTerminationStrategy: PID 24740 died... 20:33:19.487786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24740): Terminated: ok {rc=0} 20:33:19.575317 bus /sierra_3: Setting Powered False 20:33:20.676455 bus /sierra_3: Setting Powered False 20:33:21.793343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 20:33:23.051944 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:23.057886 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:33:23.109695 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:33:23.136896 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:33:23.190403 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:33:23.240919 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:33:23.268525 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:33:23.815494 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 20:33:23.821026 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:23.831864 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:33:23.869500 tst handover.py: using LAC 31355 20:33:23.990390 tst handover.py: using RAC 245 20:33:24.108874 tst handover.py: using CellId 31355 20:33:24.226390 tst handover.py: using BVCI 31356 20:33:24.337438 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:33:24.383017 tst handover.py: using LAC 31356 20:33:24.499527 tst handover.py: using RAC 246 20:33:24.616527 tst handover.py: using CellId 31356 20:33:24.733362 tst handover.py: using BVCI 31357 20:33:24.845190 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:24.856009 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:24.866816 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:24.877353 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:24.888399 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:24.899542 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:33:25.019491 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:33:25.134999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:25.581794 run create_hlr_db(pid=24746): Launched 20:33:25.697916 bus /sierra_2: Setting Powered False 20:33:26.758840 run create_hlr_db(pid=24746): Terminated: ok {rc=0} 20:33:27.178384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24748): Launched 20:33:27.504794 run osmo-hlr_10.42.42.2(pid=24749): Launched 20:33:27.631144 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:28.162987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24751): Launched 20:33:28.489329 run osmo-stp_10.42.42.5(pid=24752): Launched 20:33:28.614578 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:29.175490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24754): Launched 20:33:29.502739 run osmo-msc_10.42.42.6(pid=24755): Launched 20:33:29.686531 run osmo-stp_10.42.42.5(pid=24752): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24752)] 20:33:29.823861 run osmo-stp_10.42.42.5(pid=24752): stdout: | (launched: 2022-12-12_20:33:28.428562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:29.961481 run osmo-stp_10.42.42.5(pid=24752): stderr: | 20221212203328619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203328619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203328619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203328620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203328620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203328620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203328620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:30.097292 run osmo-stp_10.42.42.5(pid=24752): stdout: | (launched: 2022-12-12_20:33:28.428562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:30.226982 run osmo-stp_10.42.42.5(pid=24752): stderr: | 20221212203328619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203328619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203328619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203328620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203328620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203328620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203328620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:30.382350 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24752): Process ended prematurely: osmo-stp_10.42.42.5(pid=24752) [trial-2381↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24752)] [trial-2381↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 20:33:30.391502 tst handover.py:18: Test FAILED (6.6 sec) 20:33:30.419640 run osmo-hlr_10.42.42.2(pid=24749): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24749)] 20:33:30.470456 run osmo-hlr_10.42.42.2(pid=24749): stdout: | (launched: 2022-12-12_20:33:27.444128) 20:33:30.522746 run osmo-hlr_10.42.42.2(pid=24749): stderr: | 20221212203327641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203327641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203327641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203327641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203327641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203327642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203327668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203327677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203327677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203327677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:30.596439 run osmo-msc_10.42.42.6(pid=24755): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24755)] 20:33:30.647316 run osmo-msc_10.42.42.6(pid=24755): stdout: | (launched: 2022-12-12_20:33:29.441974) 20:33:30.699773 run osmo-msc_10.42.42.6(pid=24755): stderr: | 20221212203329761 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203329762 DLGLOBAL DEBUG validating counter group 0x7f74581e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203329762 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203329762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203329762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203329762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203329764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203329764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203329764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203329764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:30.752207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24748): Terminating (SIGTERM) 20:33:30.794528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24751): Terminating (SIGTERM) 20:33:30.836870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24754): Terminating (SIGTERM) 20:33:30.885537 --- ParallelTerminationStrategy: PID 24748 died... 20:33:30.916639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24748): Terminated: ok {rc=0} 20:33:30.964733 --- ParallelTerminationStrategy: PID 24751 died... 20:33:30.985589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24751): Terminated: ok {rc=0} 20:33:31.037036 --- ParallelTerminationStrategy: PID 24754 died... 20:33:31.066670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24754): Terminated: ok {rc=0} 20:33:31.175645 bus /sierra_3: Setting Powered False 20:33:32.283919 bus /sierra_3: Setting Powered False 20:33:33.402873 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2381 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 20:33:34.664260 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:34.670539 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:33:34.732519 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:33:34.759149 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:33:34.812285 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:33:34.874020 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:33:34.900081 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:33:35.447744 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2381 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 20:33:35.453098 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:35.463850 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:33:35.511660 tst handover.py: using LAC 31357 20:33:35.631651 tst handover.py: using RAC 247 20:33:35.763455 tst handover.py: using CellId 31357 20:33:35.892787 tst handover.py: using BVCI 31358 20:33:36.010752 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:33:36.069222 tst handover.py: using LAC 31358 20:33:36.195243 tst handover.py: using RAC 248 20:33:36.319280 tst handover.py: using CellId 31358 20:33:36.443388 tst handover.py: using BVCI 31359 20:33:36.558469 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:36.569658 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:36.580708 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:36.591975 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:36.603123 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:33:36.614605 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:33:36.730222 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:33:36.851122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:37.319194 run create_hlr_db(pid=24760): Launched 20:33:37.449689 bus /sierra_2: Setting Powered False 20:33:38.513955 run create_hlr_db(pid=24760): Terminated: ok {rc=0} 20:33:38.918881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Launched 20:33:39.219448 run osmo-hlr_10.42.42.2(pid=24763): Launched 20:33:39.334981 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:39.855328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Launched 20:33:40.178214 run osmo-stp_10.42.42.5(pid=24766): Launched 20:33:40.299514 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:40.852056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24768): Launched 20:33:41.174303 run osmo-msc_10.42.42.6(pid=24769): Launched 20:33:41.352693 run osmo-stp_10.42.42.5(pid=24766): ERR: Terminated: ERROR {rc=1} [trial-2381↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] 20:33:41.487736 run osmo-stp_10.42.42.5(pid=24766): stdout: | (launched: 2022-12-12_20:33:40.118631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:41.622985 run osmo-stp_10.42.42.5(pid=24766): stderr: | 20221212203340307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203340308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203340308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203340308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203340309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203340309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203340309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:41.757859 run osmo-stp_10.42.42.5(pid=24766): stdout: | (launched: 2022-12-12_20:33:40.118631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:41.885916 run osmo-stp_10.42.42.5(pid=24766): stderr: | 20221212203340307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212203340308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212203340308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212203340308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212203340309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212203340309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212203340309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:42.038870 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24766): Process ended prematurely: osmo-stp_10.42.42.5(pid=24766) [trial-2381↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] [trial-2381↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 20:33:42.047682 tst handover.py:18: Test FAILED (6.6 sec) 20:33:42.075487 run osmo-hlr_10.42.42.2(pid=24763): ERR: Terminated: ERROR {rc=237} [trial-2381↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24763)] 20:33:42.125655 run osmo-hlr_10.42.42.2(pid=24763): stdout: | (launched: 2022-12-12_20:33:39.163941) 20:33:42.177514 run osmo-hlr_10.42.42.2(pid=24763): stderr: | 20221212203339335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212203339335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212203339335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212203339335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212203339335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212203339335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212203339348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212203339356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212203339356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212203339356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:42.249727 run osmo-msc_10.42.42.6(pid=24769): ERR: Terminated: ERROR {rc=2} [trial-2381↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24769)] 20:33:42.299538 run osmo-msc_10.42.42.6(pid=24769): stdout: | (launched: 2022-12-12_20:33:41.114748) 20:33:42.351222 run osmo-msc_10.42.42.6(pid=24769): stderr: | 20221212203341433 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212203341433 DLGLOBAL DEBUG validating counter group 0x7f4e5818fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212203341433 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212203341433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212203341433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212203341434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212203341435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212203341436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212203341436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212203341436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:42.403236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Terminating (SIGTERM) 20:33:42.444726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Terminating (SIGTERM) 20:33:42.486423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24768): Terminating (SIGTERM) 20:33:42.528490 --- ParallelTerminationStrategy: PID 24762 died... 20:33:42.548530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24762): Terminated: ok {rc=0} 20:33:42.595267 --- ParallelTerminationStrategy: PID 24765 died... 20:33:42.615253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24765): Terminated: ok {rc=0} 20:33:42.661978 --- ParallelTerminationStrategy: PID 24768 died... 20:33:42.681425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24768): Terminated: ok {rc=0} 20:33:42.768060 bus /sierra_3: Setting Powered False 20:33:43.865637 bus /sierra_3: Setting Powered False 20:33:44.979271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2381 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 20:33:46.290601 tst trial-2381: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381/run.2022-12-12_19-09-05/trial-2381.xml -------------------------------------------------------------------------------------------- trial-2381 FAIL -------------------------------------------------------------------------------------------- 20:33:48.245966 tst trial-2381: trial-2381: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=17634): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17634) [trial-2381↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17634)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.6 sec) Error: osmo-stp_10.42.42.5(pid=17644): Process ended prematurely: osmo-stp_10.42.42.5(pid=17644) [trial-2381↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17644)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=17654): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17654) [trial-2381↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17654)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17664): Process ended prematurely: osmo-stp_10.42.42.5(pid=17664) [trial-2381↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17664)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17679): Process ended prematurely: osmo-stp_10.42.42.5(pid=17679) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17679)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17690): Process ended prematurely: osmo-stp_10.42.42.5(pid=17690) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17690)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17704): Process ended prematurely: osmo-stp_10.42.42.5(pid=17704) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17704)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17715): Process ended prematurely: osmo-stp_10.42.42.5(pid=17715) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17715)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17729): Process ended prematurely: osmo-stp_10.42.42.5(pid=17729) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17729)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17740): Process ended prematurely: osmo-stp_10.42.42.5(pid=17740) [trial-2381↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17740)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17754): Process ended prematurely: osmo-stp_10.42.42.5(pid=17754) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17754)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17765): Process ended prematurely: osmo-stp_10.42.42.5(pid=17765) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17765)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17779): Process ended prematurely: osmo-stp_10.42.42.5(pid=17779) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17790): Process ended prematurely: osmo-stp_10.42.42.5(pid=17790) [trial-2381↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17790)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17804): Process ended prematurely: osmo-stp_10.42.42.5(pid=17804) [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17804)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17815): Process ended prematurely: osmo-stp_10.42.42.5(pid=17815) [trial-2381↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17815)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17829): Process ended prematurely: osmo-stp_10.42.42.5(pid=17829) [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17829)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17841): Process ended prematurely: osmo-stp_10.42.42.5(pid=17841) [trial-2381↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17841)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17857): Process ended prematurely: osmo-stp_10.42.42.5(pid=17857) [trial-2381↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17857)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17872): Process ended prematurely: osmo-stp_10.42.42.5(pid=17872) [trial-2381↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17872)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=17894): Process ended prematurely: osmo-stp_10.42.42.5(pid=17894) [trial-2381↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17894)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17906): Process ended prematurely: osmo-stp_10.42.42.5(pid=17906) [trial-2381↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17906)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=17924): Process ended prematurely: osmo-stp_10.42.42.5(pid=17924) [trial-2381↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17924)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17934): Process ended prematurely: osmo-stp_10.42.42.5(pid=17934) [trial-2381↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17934)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17944): Process ended prematurely: osmo-stp_10.42.42.5(pid=17944) [trial-2381↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17944)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=17963): Process ended prematurely: osmo-stp_10.42.42.5(pid=17963) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17963)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17975): Process ended prematurely: osmo-stp_10.42.42.5(pid=17975) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17975)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=17993): Process ended prematurely: osmo-stp_10.42.42.5(pid=17993) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17993)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18003): Process ended prematurely: osmo-stp_10.42.42.5(pid=18003) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18003)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18013): Process ended prematurely: osmo-stp_10.42.42.5(pid=18013) [trial-2381↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18013)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18034): Process ended prematurely: osmo-stp_10.42.42.5(pid=18034) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18034)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18046): Process ended prematurely: osmo-stp_10.42.42.5(pid=18046) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18046)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=18064): Process ended prematurely: osmo-stp_10.42.42.5(pid=18064) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18064)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18074): Process ended prematurely: osmo-stp_10.42.42.5(pid=18074) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18074)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18084): Process ended prematurely: osmo-stp_10.42.42.5(pid=18084) [trial-2381↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18084)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18101): Process ended prematurely: osmo-stp_10.42.42.5(pid=18101) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18101)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=18113): Process ended prematurely: osmo-stp_10.42.42.5(pid=18113) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18113)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=18131): Process ended prematurely: osmo-stp_10.42.42.5(pid=18131) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18131)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18141): Process ended prematurely: osmo-stp_10.42.42.5(pid=18141) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18141)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18151): Process ended prematurely: osmo-stp_10.42.42.5(pid=18151) [trial-2381↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18151)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=18164): Process ended prematurely: osmo-stp_10.42.42.5(pid=18164) [trial-2381↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18164)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18177): Process ended prematurely: osmo-stp_10.42.42.5(pid=18177) [trial-2381↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18177)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18185): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18185) [trial-2381↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18185)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18195): Process ended prematurely: osmo-stp_10.42.42.5(pid=18195) [trial-2381↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18195)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18204) [trial-2381↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18204)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18214): Process ended prematurely: osmo-stp_10.42.42.5(pid=18214) [trial-2381↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18214)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18228): Process ended prematurely: osmo-stp_10.42.42.5(pid=18228) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18228)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18242): Process ended prematurely: osmo-stp_10.42.42.5(pid=18242) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18242)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18257): Process ended prematurely: osmo-stp_10.42.42.5(pid=18257) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18257)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18268): Process ended prematurely: osmo-stp_10.42.42.5(pid=18268) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18268)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18283): Process ended prematurely: osmo-stp_10.42.42.5(pid=18283) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18283)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18294): Process ended prematurely: osmo-stp_10.42.42.5(pid=18294) [trial-2381↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18294)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18309): Process ended prematurely: osmo-stp_10.42.42.5(pid=18309) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18309)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18320): Process ended prematurely: osmo-stp_10.42.42.5(pid=18320) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18320)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18334): Process ended prematurely: osmo-stp_10.42.42.5(pid=18334) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18334)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18345): Process ended prematurely: osmo-stp_10.42.42.5(pid=18345) [trial-2381↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18345)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18359): Process ended prematurely: osmo-stp_10.42.42.5(pid=18359) [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18359)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18370): Process ended prematurely: osmo-stp_10.42.42.5(pid=18370) [trial-2381↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18370)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18384): Process ended prematurely: osmo-stp_10.42.42.5(pid=18384) [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18384)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18395): Process ended prematurely: osmo-stp_10.42.42.5(pid=18395) [trial-2381↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18395)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18410): Process ended prematurely: osmo-stp_10.42.42.5(pid=18410) [trial-2381↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18410)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18421): Process ended prematurely: osmo-stp_10.42.42.5(pid=18421) [trial-2381↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18421)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18440): Process ended prematurely: osmo-stp_10.42.42.5(pid=18440) [trial-2381↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18440)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=18452): Process ended prematurely: osmo-stp_10.42.42.5(pid=18452) [trial-2381↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18452)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18470): Process ended prematurely: osmo-stp_10.42.42.5(pid=18470) [trial-2381↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18470)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18480): Process ended prematurely: osmo-stp_10.42.42.5(pid=18480) [trial-2381↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18480)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18490): Process ended prematurely: osmo-stp_10.42.42.5(pid=18490) [trial-2381↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18490)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=18780): Process ended prematurely: osmo-stp_10.42.42.5(pid=18780) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18780)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=18792): Process ended prematurely: osmo-stp_10.42.42.5(pid=18792) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18792)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=18818): Process ended prematurely: osmo-stp_10.42.42.5(pid=18818) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18828): Process ended prematurely: osmo-stp_10.42.42.5(pid=18828) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18828)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18838): Process ended prematurely: osmo-stp_10.42.42.5(pid=18838) [trial-2381↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18838)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=18855): Process ended prematurely: osmo-stp_10.42.42.5(pid=18855) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18855)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=18870): Process ended prematurely: osmo-stp_10.42.42.5(pid=18870) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18889): Process ended prematurely: osmo-stp_10.42.42.5(pid=18889) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18889)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18899): Process ended prematurely: osmo-stp_10.42.42.5(pid=18899) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18899)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18909): Process ended prematurely: osmo-stp_10.42.42.5(pid=18909) [trial-2381↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18909)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=18926): Process ended prematurely: osmo-stp_10.42.42.5(pid=18926) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18926)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=18939): Process ended prematurely: osmo-stp_10.42.42.5(pid=18939) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18939)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=18957): Process ended prematurely: osmo-stp_10.42.42.5(pid=18957) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18957)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18967): Process ended prematurely: osmo-stp_10.42.42.5(pid=18967) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18967)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18977): Process ended prematurely: osmo-stp_10.42.42.5(pid=18977) [trial-2381↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18977)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18990): Process ended prematurely: osmo-stp_10.42.42.5(pid=18990) [trial-2381↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18990)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19003): Process ended prematurely: osmo-stp_10.42.42.5(pid=19003) [trial-2381↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19003)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19011): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19011) [trial-2381↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19011)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=19021): Process ended prematurely: osmo-stp_10.42.42.5(pid=19021) [trial-2381↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19021)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=19030): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19030) [trial-2381↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19030)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19040): Process ended prematurely: osmo-stp_10.42.42.5(pid=19040) [trial-2381↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19040)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19054): Process ended prematurely: osmo-stp_10.42.42.5(pid=19054) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19054)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19065): Process ended prematurely: osmo-stp_10.42.42.5(pid=19065) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19065)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19080): Process ended prematurely: osmo-stp_10.42.42.5(pid=19080) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19080)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19091): Process ended prematurely: osmo-stp_10.42.42.5(pid=19091) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19091)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19105): Process ended prematurely: osmo-stp_10.42.42.5(pid=19105) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19105)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19116): Process ended prematurely: osmo-stp_10.42.42.5(pid=19116) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19116)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19130): Process ended prematurely: osmo-stp_10.42.42.5(pid=19130) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19130)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19141): Process ended prematurely: osmo-stp_10.42.42.5(pid=19141) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19141)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19156): Process ended prematurely: osmo-stp_10.42.42.5(pid=19156) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19156)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19167): Process ended prematurely: osmo-stp_10.42.42.5(pid=19167) [trial-2381↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19167)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19185): Process ended prematurely: osmo-stp_10.42.42.5(pid=19185) [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19185)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19196): Process ended prematurely: osmo-stp_10.42.42.5(pid=19196) [trial-2381↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19196)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19210): Process ended prematurely: osmo-stp_10.42.42.5(pid=19210) [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19224): Process ended prematurely: osmo-stp_10.42.42.5(pid=19224) [trial-2381↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19224)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19238): Process ended prematurely: osmo-stp_10.42.42.5(pid=19238) [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19238)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19250): Process ended prematurely: osmo-stp_10.42.42.5(pid=19250) [trial-2381↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19264): Process ended prematurely: osmo-stp_10.42.42.5(pid=19264) [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19264)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19275): Process ended prematurely: osmo-stp_10.42.42.5(pid=19275) [trial-2381↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19275)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19290): Process ended prematurely: osmo-stp_10.42.42.5(pid=19290) [trial-2381↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19301): Process ended prematurely: osmo-stp_10.42.42.5(pid=19301) [trial-2381↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19301)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=19319): Process ended prematurely: osmo-stp_10.42.42.5(pid=19319) [trial-2381↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19319)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19331): Process ended prematurely: osmo-stp_10.42.42.5(pid=19331) [trial-2381↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19331)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=19350): Process ended prematurely: osmo-stp_10.42.42.5(pid=19350) [trial-2381↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19350)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19360): Process ended prematurely: osmo-stp_10.42.42.5(pid=19360) [trial-2381↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19370): Process ended prematurely: osmo-stp_10.42.42.5(pid=19370) [trial-2381↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19370)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19388): Process ended prematurely: osmo-stp_10.42.42.5(pid=19388) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19388)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=19400): Process ended prematurely: osmo-stp_10.42.42.5(pid=19400) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19400)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19418): Process ended prematurely: osmo-stp_10.42.42.5(pid=19418) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19418)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19429): Process ended prematurely: osmo-stp_10.42.42.5(pid=19429) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19429)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19439): Process ended prematurely: osmo-stp_10.42.42.5(pid=19439) [trial-2381↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19439)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19456): Process ended prematurely: osmo-stp_10.42.42.5(pid=19456) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19456)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19468): Process ended prematurely: osmo-stp_10.42.42.5(pid=19468) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19468)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19487): Process ended prematurely: osmo-stp_10.42.42.5(pid=19487) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19487)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19497): Process ended prematurely: osmo-stp_10.42.42.5(pid=19497) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19497)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19507): Process ended prematurely: osmo-stp_10.42.42.5(pid=19507) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19507)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19524): Process ended prematurely: osmo-stp_10.42.42.5(pid=19524) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19524)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19541): Process ended prematurely: osmo-stp_10.42.42.5(pid=19541) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19541)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19559): Process ended prematurely: osmo-stp_10.42.42.5(pid=19559) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19559)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19572): Process ended prematurely: osmo-stp_10.42.42.5(pid=19572) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19572)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19582): Process ended prematurely: osmo-stp_10.42.42.5(pid=19582) [trial-2381↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19582)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=19599): Process ended prematurely: osmo-stp_10.42.42.5(pid=19599) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19599)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=19611): Process ended prematurely: osmo-stp_10.42.42.5(pid=19611) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19611)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19631): Process ended prematurely: osmo-stp_10.42.42.5(pid=19631) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19631)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19641): Process ended prematurely: osmo-stp_10.42.42.5(pid=19641) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19641)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19651): Process ended prematurely: osmo-stp_10.42.42.5(pid=19651) [trial-2381↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19651)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19666): Process ended prematurely: osmo-stp_10.42.42.5(pid=19666) [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19666)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19679): Process ended prematurely: osmo-stp_10.42.42.5(pid=19679) [trial-2381↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19679)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19687): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19687) [trial-2381↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19687)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19698): Process ended prematurely: osmo-stp_10.42.42.5(pid=19698) [trial-2381↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19698)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19707): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19707) [trial-2381↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19707)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19717): Process ended prematurely: osmo-stp_10.42.42.5(pid=19717) [trial-2381↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19717)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19731): Process ended prematurely: osmo-stp_10.42.42.5(pid=19731) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19731)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19748): Process ended prematurely: osmo-stp_10.42.42.5(pid=19748) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19748)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19763): Process ended prematurely: osmo-stp_10.42.42.5(pid=19763) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19763)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19776): Process ended prematurely: osmo-stp_10.42.42.5(pid=19776) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19776)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19790): Process ended prematurely: osmo-stp_10.42.42.5(pid=19790) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19801): Process ended prematurely: osmo-stp_10.42.42.5(pid=19801) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19801)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19815): Process ended prematurely: osmo-stp_10.42.42.5(pid=19815) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19815)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19826): Process ended prematurely: osmo-stp_10.42.42.5(pid=19826) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19826)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=20111): Process ended prematurely: osmo-stp_10.42.42.5(pid=20111) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20111)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20122): Process ended prematurely: osmo-stp_10.42.42.5(pid=20122) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20122)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20137): Process ended prematurely: osmo-stp_10.42.42.5(pid=20137) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20137)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20148): Process ended prematurely: osmo-stp_10.42.42.5(pid=20148) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20148)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20167): Process ended prematurely: osmo-stp_10.42.42.5(pid=20167) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20167)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20178): Process ended prematurely: osmo-stp_10.42.42.5(pid=20178) [trial-2381↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20178)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20192): Process ended prematurely: osmo-stp_10.42.42.5(pid=20192) [trial-2381↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20192)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20206): Process ended prematurely: osmo-stp_10.42.42.5(pid=20206) [trial-2381↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20206)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20224): Process ended prematurely: osmo-stp_10.42.42.5(pid=20224) [trial-2381↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20224)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20236): Process ended prematurely: osmo-stp_10.42.42.5(pid=20236) [trial-2381↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=20254): Process ended prematurely: osmo-stp_10.42.42.5(pid=20254) [trial-2381↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20254)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20265): Process ended prematurely: osmo-stp_10.42.42.5(pid=20265) [trial-2381↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20265)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20275): Process ended prematurely: osmo-stp_10.42.42.5(pid=20275) [trial-2381↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20292): Process ended prematurely: osmo-stp_10.42.42.5(pid=20292) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20304): Process ended prematurely: osmo-stp_10.42.42.5(pid=20304) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20304)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20322): Process ended prematurely: osmo-stp_10.42.42.5(pid=20322) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20322)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20333): Process ended prematurely: osmo-stp_10.42.42.5(pid=20333) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20333)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20343): Process ended prematurely: osmo-stp_10.42.42.5(pid=20343) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20343)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20360): Process ended prematurely: osmo-stp_10.42.42.5(pid=20360) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20360)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=20372): Process ended prematurely: osmo-stp_10.42.42.5(pid=20372) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20372)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=20390): Process ended prematurely: osmo-stp_10.42.42.5(pid=20390) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20390)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20401): Process ended prematurely: osmo-stp_10.42.42.5(pid=20401) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20411): Process ended prematurely: osmo-stp_10.42.42.5(pid=20411) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20411)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20429): Process ended prematurely: osmo-stp_10.42.42.5(pid=20429) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20429)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20441): Process ended prematurely: osmo-stp_10.42.42.5(pid=20441) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20441)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20459): Process ended prematurely: osmo-stp_10.42.42.5(pid=20459) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20459)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20469): Process ended prematurely: osmo-stp_10.42.42.5(pid=20469) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20469)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20479): Process ended prematurely: osmo-stp_10.42.42.5(pid=20479) [trial-2381↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20479)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20492): Process ended prematurely: osmo-stp_10.42.42.5(pid=20492) [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20492)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20506): Process ended prematurely: osmo-stp_10.42.42.5(pid=20506) [trial-2381↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20506)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20514) [trial-2381↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20514)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20524): Process ended prematurely: osmo-stp_10.42.42.5(pid=20524) [trial-2381↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20524)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20536) [trial-2381↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20536)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20547): Process ended prematurely: osmo-stp_10.42.42.5(pid=20547) [trial-2381↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20547)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20572): Process ended prematurely: osmo-stp_10.42.42.5(pid=20572) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20572)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20586): Process ended prematurely: osmo-stp_10.42.42.5(pid=20586) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20586)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20597): Process ended prematurely: osmo-stp_10.42.42.5(pid=20597) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20597)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20611): Process ended prematurely: osmo-stp_10.42.42.5(pid=20611) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20611)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20623): Process ended prematurely: osmo-stp_10.42.42.5(pid=20623) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20623)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20637): Process ended prematurely: osmo-stp_10.42.42.5(pid=20637) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20637)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20648): Process ended prematurely: osmo-stp_10.42.42.5(pid=20648) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20648)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20662): Process ended prematurely: osmo-stp_10.42.42.5(pid=20662) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20662)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20673): Process ended prematurely: osmo-stp_10.42.42.5(pid=20673) [trial-2381↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20673)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20687): Process ended prematurely: osmo-stp_10.42.42.5(pid=20687) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20687)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20698): Process ended prematurely: osmo-stp_10.42.42.5(pid=20698) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20698)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20713): Process ended prematurely: osmo-stp_10.42.42.5(pid=20713) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20713)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20724): Process ended prematurely: osmo-stp_10.42.42.5(pid=20724) [trial-2381↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20724)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20738): Process ended prematurely: osmo-stp_10.42.42.5(pid=20738) [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20749): Process ended prematurely: osmo-stp_10.42.42.5(pid=20749) [trial-2381↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20749)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20763): Process ended prematurely: osmo-stp_10.42.42.5(pid=20763) [trial-2381↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20763)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20774): Process ended prematurely: osmo-stp_10.42.42.5(pid=20774) [trial-2381↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20774)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20793): Process ended prematurely: osmo-stp_10.42.42.5(pid=20793) [trial-2381↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20793)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20805): Process ended prematurely: osmo-stp_10.42.42.5(pid=20805) [trial-2381↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20823): Process ended prematurely: osmo-stp_10.42.42.5(pid=20823) [trial-2381↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20823)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20834): Process ended prematurely: osmo-stp_10.42.42.5(pid=20834) [trial-2381↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20834)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20844): Process ended prematurely: osmo-stp_10.42.42.5(pid=20844) [trial-2381↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20844)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20866): Process ended prematurely: osmo-stp_10.42.42.5(pid=20866) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20866)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20878): Process ended prematurely: osmo-stp_10.42.42.5(pid=20878) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20878)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=20899): Process ended prematurely: osmo-stp_10.42.42.5(pid=20899) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20899)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20909): Process ended prematurely: osmo-stp_10.42.42.5(pid=20909) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20909)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20919): Process ended prematurely: osmo-stp_10.42.42.5(pid=20919) [trial-2381↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20919)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=20936): Process ended prematurely: osmo-stp_10.42.42.5(pid=20936) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20936)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20948): Process ended prematurely: osmo-stp_10.42.42.5(pid=20948) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20948)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20966): Process ended prematurely: osmo-stp_10.42.42.5(pid=20966) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20966)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20977): Process ended prematurely: osmo-stp_10.42.42.5(pid=20977) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20977)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20987): Process ended prematurely: osmo-stp_10.42.42.5(pid=20987) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20987)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21006): Process ended prematurely: osmo-stp_10.42.42.5(pid=21006) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21006)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21036): Process ended prematurely: osmo-stp_10.42.42.5(pid=21036) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21036)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21056): Process ended prematurely: osmo-stp_10.42.42.5(pid=21056) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21056)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21066): Process ended prematurely: osmo-stp_10.42.42.5(pid=21066) [trial-2381↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21066)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21083): Process ended prematurely: osmo-stp_10.42.42.5(pid=21083) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21083)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21095): Process ended prematurely: osmo-stp_10.42.42.5(pid=21095) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21095)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21113): Process ended prematurely: osmo-stp_10.42.42.5(pid=21113) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21113)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21123): Process ended prematurely: osmo-stp_10.42.42.5(pid=21123) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21123)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21133): Process ended prematurely: osmo-stp_10.42.42.5(pid=21133) [trial-2381↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21133)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21146): Process ended prematurely: osmo-stp_10.42.42.5(pid=21146) [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21146)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21432): Process ended prematurely: osmo-stp_10.42.42.5(pid=21432) [trial-2381↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21432)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.6 sec) Error: osmo-nitb_10.42.42.2(pid=21440): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21440) [trial-2381↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21440)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21451): Process ended prematurely: osmo-stp_10.42.42.5(pid=21451) [trial-2381↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21451)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=21460): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21460) [trial-2381↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21460)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=21470): Process ended prematurely: osmo-stp_10.42.42.5(pid=21470) [trial-2381↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21470)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21487): Process ended prematurely: osmo-stp_10.42.42.5(pid=21487) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21487)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21498): Process ended prematurely: osmo-stp_10.42.42.5(pid=21498) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21512): Process ended prematurely: osmo-stp_10.42.42.5(pid=21512) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21512)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21526): Process ended prematurely: osmo-stp_10.42.42.5(pid=21526) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21526)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21552): Process ended prematurely: osmo-stp_10.42.42.5(pid=21552) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21552)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21566): Process ended prematurely: osmo-stp_10.42.42.5(pid=21566) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21566)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21577): Process ended prematurely: osmo-stp_10.42.42.5(pid=21577) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21577)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21591): Process ended prematurely: osmo-stp_10.42.42.5(pid=21591) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21591)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21602): Process ended prematurely: osmo-stp_10.42.42.5(pid=21602) [trial-2381↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21602)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21617): Process ended prematurely: osmo-stp_10.42.42.5(pid=21617) [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21617)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21629): Process ended prematurely: osmo-stp_10.42.42.5(pid=21629) [trial-2381↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21629)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21643): Process ended prematurely: osmo-stp_10.42.42.5(pid=21643) [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21643)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21654): Process ended prematurely: osmo-stp_10.42.42.5(pid=21654) [trial-2381↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21654)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21668): Process ended prematurely: osmo-stp_10.42.42.5(pid=21668) [trial-2381↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21668)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21679): Process ended prematurely: osmo-stp_10.42.42.5(pid=21679) [trial-2381↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21679)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21697): Process ended prematurely: osmo-stp_10.42.42.5(pid=21697) [trial-2381↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21697)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21709): Process ended prematurely: osmo-stp_10.42.42.5(pid=21709) [trial-2381↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21709)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21727): Process ended prematurely: osmo-stp_10.42.42.5(pid=21727) [trial-2381↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21727)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21737): Process ended prematurely: osmo-stp_10.42.42.5(pid=21737) [trial-2381↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21737)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21748): Process ended prematurely: osmo-stp_10.42.42.5(pid=21748) [trial-2381↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21748)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21765): Process ended prematurely: osmo-stp_10.42.42.5(pid=21765) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21765)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21777): Process ended prematurely: osmo-stp_10.42.42.5(pid=21777) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21777)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21795): Process ended prematurely: osmo-stp_10.42.42.5(pid=21795) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21795)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21806): Process ended prematurely: osmo-stp_10.42.42.5(pid=21806) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21806)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21816): Process ended prematurely: osmo-stp_10.42.42.5(pid=21816) [trial-2381↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21816)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=21838): Process ended prematurely: osmo-stp_10.42.42.5(pid=21838) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=21850): Process ended prematurely: osmo-stp_10.42.42.5(pid=21850) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21850)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=21868): Process ended prematurely: osmo-stp_10.42.42.5(pid=21868) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21868)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21891): Process ended prematurely: osmo-stp_10.42.42.5(pid=21891) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21891)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21909): Process ended prematurely: osmo-stp_10.42.42.5(pid=21909) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21909)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21921): Process ended prematurely: osmo-stp_10.42.42.5(pid=21921) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21921)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=21939): Process ended prematurely: osmo-stp_10.42.42.5(pid=21939) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21939)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21949): Process ended prematurely: osmo-stp_10.42.42.5(pid=21949) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21949)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21959): Process ended prematurely: osmo-stp_10.42.42.5(pid=21959) [trial-2381↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21959)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21973): Process ended prematurely: osmo-stp_10.42.42.5(pid=21973) [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21973)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21987): Process ended prematurely: osmo-stp_10.42.42.5(pid=21987) [trial-2381↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21987)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21995): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21995) [trial-2381↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21995)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22005): Process ended prematurely: osmo-stp_10.42.42.5(pid=22005) [trial-2381↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22005)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22014) [trial-2381↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22014)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=22024): Process ended prematurely: osmo-stp_10.42.42.5(pid=22024) [trial-2381↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22024)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22038): Process ended prematurely: osmo-stp_10.42.42.5(pid=22038) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22049): Process ended prematurely: osmo-stp_10.42.42.5(pid=22049) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22049)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22063): Process ended prematurely: osmo-stp_10.42.42.5(pid=22063) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22075): Process ended prematurely: osmo-stp_10.42.42.5(pid=22075) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22075)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22089): Process ended prematurely: osmo-stp_10.42.42.5(pid=22089) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22089)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22100): Process ended prematurely: osmo-stp_10.42.42.5(pid=22100) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22100)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22114): Process ended prematurely: osmo-stp_10.42.42.5(pid=22114) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22114)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22125): Process ended prematurely: osmo-stp_10.42.42.5(pid=22125) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22125)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22139): Process ended prematurely: osmo-stp_10.42.42.5(pid=22139) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22139)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22151): Process ended prematurely: osmo-stp_10.42.42.5(pid=22151) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22151)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22165): Process ended prematurely: osmo-stp_10.42.42.5(pid=22165) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22165)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22176): Process ended prematurely: osmo-stp_10.42.42.5(pid=22176) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22176)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22191): Process ended prematurely: osmo-stp_10.42.42.5(pid=22191) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22191)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22202): Process ended prematurely: osmo-stp_10.42.42.5(pid=22202) [trial-2381↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22202)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22216): Process ended prematurely: osmo-stp_10.42.42.5(pid=22216) [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22216)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22230): Process ended prematurely: osmo-stp_10.42.42.5(pid=22230) [trial-2381↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22230)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22248): Process ended prematurely: osmo-stp_10.42.42.5(pid=22248) [trial-2381↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22248)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22261): Process ended prematurely: osmo-stp_10.42.42.5(pid=22261) [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22261)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22279): Process ended prematurely: osmo-stp_10.42.42.5(pid=22279) [trial-2381↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22279)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22289): Process ended prematurely: osmo-stp_10.42.42.5(pid=22289) [trial-2381↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22289)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22305): Process ended prematurely: osmo-stp_10.42.42.5(pid=22305) [trial-2381↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22305)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=22322): Process ended prematurely: osmo-stp_10.42.42.5(pid=22322) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22322)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22334): Process ended prematurely: osmo-stp_10.42.42.5(pid=22334) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22334)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22353): Process ended prematurely: osmo-stp_10.42.42.5(pid=22353) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22353)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22363): Process ended prematurely: osmo-stp_10.42.42.5(pid=22363) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22363)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22373): Process ended prematurely: osmo-stp_10.42.42.5(pid=22373) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22373)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22390): Process ended prematurely: osmo-stp_10.42.42.5(pid=22390) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22390)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22402): Process ended prematurely: osmo-stp_10.42.42.5(pid=22402) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22420): Process ended prematurely: osmo-stp_10.42.42.5(pid=22420) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22420)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22430): Process ended prematurely: osmo-stp_10.42.42.5(pid=22430) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22430)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22441): Process ended prematurely: osmo-stp_10.42.42.5(pid=22441) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22441)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22458): Process ended prematurely: osmo-stp_10.42.42.5(pid=22458) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22470): Process ended prematurely: osmo-stp_10.42.42.5(pid=22470) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] FAIL: iperf3m4.py (12.0 sec) Error: osmo-stp_10.42.42.5(pid=22759): Process ended prematurely: osmo-stp_10.42.42.5(pid=22759) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22759)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=22769): Process ended prematurely: osmo-stp_10.42.42.5(pid=22769) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22769)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22779): Process ended prematurely: osmo-stp_10.42.42.5(pid=22779) [trial-2381↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22779)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22792): Process ended prematurely: osmo-stp_10.42.42.5(pid=22792) [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22792)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22808): Process ended prematurely: osmo-stp_10.42.42.5(pid=22808) [trial-2381↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=22816): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22816) [trial-2381↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22816)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22826): Process ended prematurely: osmo-stp_10.42.42.5(pid=22826) [trial-2381↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22826)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=22839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22839) [trial-2381↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22839)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=22850): Process ended prematurely: osmo-stp_10.42.42.5(pid=22850) [trial-2381↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22850)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22865): Process ended prematurely: osmo-stp_10.42.42.5(pid=22865) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22865)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22876): Process ended prematurely: osmo-stp_10.42.42.5(pid=22876) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22876)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22891): Process ended prematurely: osmo-stp_10.42.42.5(pid=22891) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22891)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22902): Process ended prematurely: osmo-stp_10.42.42.5(pid=22902) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22902)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22916): Process ended prematurely: osmo-stp_10.42.42.5(pid=22916) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22916)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22927): Process ended prematurely: osmo-stp_10.42.42.5(pid=22927) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22927)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22941): Process ended prematurely: osmo-stp_10.42.42.5(pid=22941) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22941)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22952): Process ended prematurely: osmo-stp_10.42.42.5(pid=22952) [trial-2381↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22952)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22966): Process ended prematurely: osmo-stp_10.42.42.5(pid=22966) [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22966)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22977): Process ended prematurely: osmo-stp_10.42.42.5(pid=22977) [trial-2381↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22977)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22992): Process ended prematurely: osmo-stp_10.42.42.5(pid=22992) [trial-2381↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22992)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23003): Process ended prematurely: osmo-stp_10.42.42.5(pid=23003) [trial-2381↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23003)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23021): Process ended prematurely: osmo-stp_10.42.42.5(pid=23021) [trial-2381↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23021)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23033): Process ended prematurely: osmo-stp_10.42.42.5(pid=23033) [trial-2381↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23033)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=23051): Process ended prematurely: osmo-stp_10.42.42.5(pid=23051) [trial-2381↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23051)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23061): Process ended prematurely: osmo-stp_10.42.42.5(pid=23061) [trial-2381↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23061)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23071): Process ended prematurely: osmo-stp_10.42.42.5(pid=23071) [trial-2381↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23071)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23088): Process ended prematurely: osmo-stp_10.42.42.5(pid=23088) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23088)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23100): Process ended prematurely: osmo-stp_10.42.42.5(pid=23100) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23100)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=23118): Process ended prematurely: osmo-stp_10.42.42.5(pid=23118) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23118)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23128): Process ended prematurely: osmo-stp_10.42.42.5(pid=23128) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23128)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23138): Process ended prematurely: osmo-stp_10.42.42.5(pid=23138) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23138)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23158): Process ended prematurely: osmo-stp_10.42.42.5(pid=23158) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23158)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23170): Process ended prematurely: osmo-stp_10.42.42.5(pid=23170) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23170)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=23191): Process ended prematurely: osmo-stp_10.42.42.5(pid=23191) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23191)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23201): Process ended prematurely: osmo-stp_10.42.42.5(pid=23201) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23201)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23213): Process ended prematurely: osmo-stp_10.42.42.5(pid=23213) [trial-2381↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23213)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23226): Process ended prematurely: osmo-stp_10.42.42.5(pid=23226) [trial-2381↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23226)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23239): Process ended prematurely: osmo-stp_10.42.42.5(pid=23239) [trial-2381↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23239)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23248): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23248) [trial-2381↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23248)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23258): Process ended prematurely: osmo-stp_10.42.42.5(pid=23258) [trial-2381↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23258)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23272): Process ended prematurely: osmo-stp_10.42.42.5(pid=23272) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23272)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23283): Process ended prematurely: osmo-stp_10.42.42.5(pid=23283) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23283)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23297): Process ended prematurely: osmo-stp_10.42.42.5(pid=23297) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23297)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23308): Process ended prematurely: osmo-stp_10.42.42.5(pid=23308) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23308)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23322): Process ended prematurely: osmo-stp_10.42.42.5(pid=23322) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23322)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23350): Process ended prematurely: osmo-stp_10.42.42.5(pid=23350) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23350)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23366): Process ended prematurely: osmo-stp_10.42.42.5(pid=23366) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23366)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23377): Process ended prematurely: osmo-stp_10.42.42.5(pid=23377) [trial-2381↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23377)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23391): Process ended prematurely: osmo-stp_10.42.42.5(pid=23391) [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23391)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23402): Process ended prematurely: osmo-stp_10.42.42.5(pid=23402) [trial-2381↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23402)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23418): Process ended prematurely: osmo-stp_10.42.42.5(pid=23418) [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23418)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23429): Process ended prematurely: osmo-stp_10.42.42.5(pid=23429) [trial-2381↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23429)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23443): Process ended prematurely: osmo-stp_10.42.42.5(pid=23443) [trial-2381↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23443)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23454): Process ended prematurely: osmo-stp_10.42.42.5(pid=23454) [trial-2381↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23454)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23472): Process ended prematurely: osmo-stp_10.42.42.5(pid=23472) [trial-2381↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23472)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23484): Process ended prematurely: osmo-stp_10.42.42.5(pid=23484) [trial-2381↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23484)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=23502): Process ended prematurely: osmo-stp_10.42.42.5(pid=23502) [trial-2381↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23514): Process ended prematurely: osmo-stp_10.42.42.5(pid=23514) [trial-2381↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23514)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23524): Process ended prematurely: osmo-stp_10.42.42.5(pid=23524) [trial-2381↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23524)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23541): Process ended prematurely: osmo-stp_10.42.42.5(pid=23541) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23541)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23556): Process ended prematurely: osmo-stp_10.42.42.5(pid=23556) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23556)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=23577): Process ended prematurely: osmo-stp_10.42.42.5(pid=23577) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23577)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23587): Process ended prematurely: osmo-stp_10.42.42.5(pid=23587) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23587)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23597): Process ended prematurely: osmo-stp_10.42.42.5(pid=23597) [trial-2381↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23597)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23615): Process ended prematurely: osmo-stp_10.42.42.5(pid=23615) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23615)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=23627): Process ended prematurely: osmo-stp_10.42.42.5(pid=23627) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23627)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=23645): Process ended prematurely: osmo-stp_10.42.42.5(pid=23645) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23645)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23655): Process ended prematurely: osmo-stp_10.42.42.5(pid=23655) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23655)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23665): Process ended prematurely: osmo-stp_10.42.42.5(pid=23665) [trial-2381↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23683): Process ended prematurely: osmo-stp_10.42.42.5(pid=23683) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23683)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23695): Process ended prematurely: osmo-stp_10.42.42.5(pid=23695) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23695)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=23713): Process ended prematurely: osmo-stp_10.42.42.5(pid=23713) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23713)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23724): Process ended prematurely: osmo-stp_10.42.42.5(pid=23724) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23724)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23734): Process ended prematurely: osmo-stp_10.42.42.5(pid=23734) [trial-2381↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23734)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23747): Process ended prematurely: osmo-stp_10.42.42.5(pid=23747) [trial-2381↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23747)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=23756): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23756) [trial-2381↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23756)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=23758): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23758) [trial-2381↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23758)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=23760): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23760) [trial-2381↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23760)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23762): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23762) [trial-2381↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23762)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=23772): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23772) [trial-2381↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23772)] FAIL: esme_connect_policy_closed.py (6.2 sec) Error: osmo-hlr_10.42.42.2(pid=23783): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23783) [trial-2381↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23783)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23795): Process ended prematurely: osmo-stp_10.42.42.5(pid=23795) [trial-2381↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23795)] FAIL: esme_ms_sms_transaction.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23806): Process ended prematurely: osmo-stp_10.42.42.5(pid=23806) [trial-2381↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23806)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24089): Process ended prematurely: osmo-stp_10.42.42.5(pid=24089) [trial-2381↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24089)] FAIL: register_a5_0_authreq.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24102): Process ended prematurely: osmo-stp_10.42.42.5(pid=24102) [trial-2381↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24102)] FAIL: register_a5_1_authreq.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24113): Process ended prematurely: osmo-stp_10.42.42.5(pid=24113) [trial-2381↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24113)] FAIL: register_a5_3_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24126): Process ended prematurely: osmo-stp_10.42.42.5(pid=24126) [trial-2381↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24126)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.3 sec) Error: srsepc(pid=24146): Process ended prematurely: srsepc(pid=24146) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24146)] FAIL: iperf3_bidir.py (19.3 sec) Error: srsepc(pid=24164): Process ended prematurely: srsepc(pid=24164) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24164)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=24183): Process ended prematurely: srsepc(pid=24183) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24183)] FAIL: iperf3_ul.py (19.0 sec) Error: srsepc(pid=24199): Process ended prematurely: srsepc(pid=24199) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24199)] FAIL: ping.py (18.8 sec) Error: srsepc(pid=24215): Process ended prematurely: srsepc(pid=24215) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24215)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=24231): Process ended prematurely: srsepc(pid=24231) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24231)] FAIL: rrc_idle_mt_ping.py (18.6 sec) Error: srsepc(pid=24247): Process ended prematurely: srsepc(pid=24247) [trial-2381↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24247)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24260): Process ended prematurely: osmo-stp_10.42.42.5(pid=24260) [trial-2381↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24260)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24277): Process ended prematurely: osmo-stp_10.42.42.5(pid=24277) [trial-2381↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=24291): Process ended prematurely: osmo-stp_10.42.42.5(pid=24291) [trial-2381↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24291)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24305): Process ended prematurely: osmo-stp_10.42.42.5(pid=24305) [trial-2381↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24305)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2381↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24334): Process ended prematurely: osmo-stp_10.42.42.5(pid=24334) [trial-2381↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24334)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=24348): Process ended prematurely: osmo-stp_10.42.42.5(pid=24348) [trial-2381↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24348)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24362): Process ended prematurely: osmo-stp_10.42.42.5(pid=24362) [trial-2381↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24362)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24376): Process ended prematurely: osmo-stp_10.42.42.5(pid=24376) [trial-2381↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24376)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24390): Process ended prematurely: osmo-stp_10.42.42.5(pid=24390) [trial-2381↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24404): Process ended prematurely: osmo-stp_10.42.42.5(pid=24404) [trial-2381↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24404)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2381↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24432): Process ended prematurely: osmo-stp_10.42.42.5(pid=24432) [trial-2381↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24432)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24448): Process ended prematurely: osmo-stp_10.42.42.5(pid=24448) [trial-2381↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24448)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24466): Process ended prematurely: osmo-stp_10.42.42.5(pid=24466) [trial-2381↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24466)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=24480): Process ended prematurely: osmo-stp_10.42.42.5(pid=24480) [trial-2381↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24480)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24494): Process ended prematurely: osmo-stp_10.42.42.5(pid=24494) [trial-2381↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24494)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24511): Process ended prematurely: osmo-stp_10.42.42.5(pid=24511) [trial-2381↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24511)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24525): Process ended prematurely: osmo-stp_10.42.42.5(pid=24525) [trial-2381↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24525)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24539): Process ended prematurely: osmo-stp_10.42.42.5(pid=24539) [trial-2381↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24539)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=24553): Process ended prematurely: osmo-stp_10.42.42.5(pid=24553) [trial-2381↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24553)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24567): Process ended prematurely: osmo-stp_10.42.42.5(pid=24567) [trial-2381↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24567)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24582): Process ended prematurely: osmo-stp_10.42.42.5(pid=24582) [trial-2381↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24582)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24596): Process ended prematurely: osmo-stp_10.42.42.5(pid=24596) [trial-2381↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24596)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=24610): Process ended prematurely: osmo-stp_10.42.42.5(pid=24610) [trial-2381↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24610)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24624): Process ended prematurely: osmo-stp_10.42.42.5(pid=24624) [trial-2381↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24624)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24638): Process ended prematurely: osmo-stp_10.42.42.5(pid=24638) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24652): Process ended prematurely: osmo-stp_10.42.42.5(pid=24652) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24652)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24666): Process ended prematurely: osmo-stp_10.42.42.5(pid=24666) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24666)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24680): Process ended prematurely: osmo-stp_10.42.42.5(pid=24680) [trial-2381↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24680)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24694): Process ended prematurely: osmo-stp_10.42.42.5(pid=24694) [trial-2381↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24694)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24709): Process ended prematurely: osmo-stp_10.42.42.5(pid=24709) [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24709)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24724): Process ended prematurely: osmo-stp_10.42.42.5(pid=24724) [trial-2381↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24724)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24738): Process ended prematurely: osmo-stp_10.42.42.5(pid=24738) [trial-2381↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24738)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24752): Process ended prematurely: osmo-stp_10.42.42.5(pid=24752) [trial-2381↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24752)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24766): Process ended prematurely: osmo-stp_10.42.42.5(pid=24766) [trial-2381↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24766)] + rm -rf trial-2381/inst + cd trial-2381 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-12 19:08:53 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381-run.tgz run.2022-12-12_19-09-05 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2381-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29296.tgz osmo-nitb.build-12984.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30079.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE